Job Overview
Job description
- Location:
- Entroncamento, Portugal
- Work arrangement:
- On-site
Role Summary
We are looking for a Lead Data Software Engineer to become an integral part of our energetic team.
In this position, you will create and enhance powerful data solutions to cater to our broad customer base. You will utilize your skills in Python, PySpark, and Azure technologies to drive our products towards enhanced performance and expanded scalability.
Responsibilities - Develop and enhance scalable data products targeting a wide consumer audience
- Enhance and fine-tune data pipelines utilizing Python and PySpark
- Manage and streamline Azure Databricks environments
- Employ Azure DevOps pipelines and/or GitHub Actions for efficient data solutions deployment
- Work closely with interdisciplinary teams to convert business requirements into technical specifications
- Follow software engineering best practices throughout the project cycle
- Participate in the expansion and upkeep of the Databricks Unity Catalog
- Advance data processing and storage solutions in the Azure data ecosystem
Requirements - Minimum of 5 years' experience in the field of data software engineering
- Over 1 year of proven leadership experience
- Proficiency in Python and PySpark, with a proven history of developing large-scale data products
- Competency in deploying and maintaining Azure Databricks solutions
- Qualifications in managing pipelines via Azure DevOps and/or GitHub Actions
- Understanding of the Azure data environment, including Azure Event Hubs and Terraform
- Fluent in English with B2+ level communication skills
Nice to have - Capability to develop APIs using Python
- Experience with Google Cloud Platform (GCP)
We offer - Competitive compensation depending on experience and skills
- Variety of projects within one company
- Being a part of a project following engineering excellence standards
- Individual career path and professional growth opportunities
- Internal events and communities
- Flexible work hours
- Role:
- Lead Data Software Engineer
- Job Type:
- Senior Level | Software Engineering
Company profile
EPAM Systems
epam.comEPAM Systems, Inc., also known as EPAM, is a globally active US provider of software engineering and IT consulting services. The company runs software development centers and branch offices in North America, Europe, Asia and Australia, and its offices in Germany are in Frankfurt am Main and Berlin. EPAM Systems took shape in 2002 when two companies set up by Arkadiy Dobkin in Princeton, New Jersey, and Leo Lozner in Minsk, Belarus, were merged. The name originally stood for Effective Programming For America, and the shares were first offered on the New York Stock Exchange in January 2012.
- Company Size
- 50,000 - 100,000 employees
- Headquarters
- Newtown, Pennsylvania, United States
- Founded
- 1993
- Funding Stage
- Public