Job Overview
Job description
- Location:
- Madrid, Spain
- Work arrangement:
- On-site
Role Summary
Are you an open-minded professional person fluent in the Scala programming language? If that describes you, this could be the perfect opportunity to join EPAM as a Data Engineering Leader. We are looking for someone who works as a team, with excellent communication and organization skills, a master's degree in engineering and a B2+/C1 level of English to communicate fluently with English-speaking interlocutors, share ideas and reasoning.
As part of this project, our Data teams are working on migrating Data Products workflows from Oracle to Databricks. At EPAM, you will enter a dynamic and agile work environment, helping Fortune 1000 clients while adhering to engineering best practices. If you are a Scala expert with a passion for transforming data solutions, join us in Madrid, Malaga or remotely across Spain to be at the forefront of innovation with EPAM.
What will your duties be? - Develop, monitor and operate the most used and critical data flow in the client - Sales Order Data (incl. post-order information, e.g., shipping, return, payment)
- Consult with analysts, data scientists and product managers to build and continually improve "Single Source of Truth" KPI for business direction, such as the core measure of Profit Contribution (PC II)
- Redevelop old legacy workflows to new advanced and standard versions that are easy to maintain and scalable for future demands
- Leverage and enhance a suite of cloud-based technologies including AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
What are we looking for? - Experience in Apache Spark along with Spark Streaming
- Solid practical experience with Databricks and delta-lake
- Fluency in the Scala programming language
- Experience in SQL
- Good knowledge and practical experience with CI/CD
- Extensive experience working with GitHub
- Fluency working with the AWS environment
- Ability to build workflows with Apache Airflow
It will give you an advantage - Presto
- Superset
-Starburst
- Oracle & Exasol
What do we offer? - Private medical insurance
- EPAM Employee Stock Purchase Plan
- 100% paid sick leave
- Referral Program
- Professional certification
- Language courses
- Role:
- Lead Data Software Engineer (Spark/Scala/Databricks)
- Job Type:
- Mid Level | Unknown