Senior Data Engineer

Role Summary

We are seeking a skilled and motivated Senior Data Engineer to join our team. Your primary role will involve designing, building, and optimizing large-scale data processing pipelines, using your hands-on experience in PySpark or Apache Spark. The ideal candidate will have a strong understanding of distributed data systems, be capable of working with complex datasets, and be passionate about solving data challenges in a scalable and efficient way.

Responsibilities - Design, build, and optimize large-scale data processing pipelines using PySpark or Apache Spark

• Develop and maintain data processing applications and data integration solutions
• Collaborate with data scientists and analysts to understand data requirements and deliver effective data solutions
• Work with cross-functional teams to ensure the scalability, reliability, and efficiency of data processing pipelines
• Implement and maintain CI/CD pipelines for data engineering projects
• Contribute to the design and development of data storage and retrieval solutions using MongoDB and AWS services
• Optimize data processing workflows for performance and scalability
• Troubleshoot and debug data processing issues, ensuring the integrity and quality of processed data
• Stay updated with the latest trends and advancements in data engineering and contribute to the continuous improvement of data processing practices

Requirements - Minimum 3 years of professional experience as a Data Engineer, with a strong focus on building and optimizing large-scale data processing pipelines

• Hands-on experience in PySpark or Apache Spark, and proficient in Python for data manipulation and analysis
• Expertise in Amazon Web Services (AWS) for data storage, processing, and analysis
• Proficiency in working with MongoDB for data storage and retrieval
• Strong understanding of distributed data systems and the ability to work with complex datasets
• Passionate about solving data challenges in a scalable and efficient way
• Excellent communication skills and the ability to collaborate with cross-functional teams
• B2+ English level proficiency

Nice to have - Knowledge of CI/CD, Cucumber

We offer - Career plan and real growth opportunities

• Unlimited access to LinkedIn learning solutions
• International Mobility Plan within 25 countries
• Constant training, mentoring, online corporate courses, eLearning and more
• English classes with a certified teacher
• Support for employee's initiatives (Algorithms club, toastmasters, agile club and more)
• Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams and more)
• Flexible work schedule and dress code
• Collaborate in a multicultural environment and share best practices from around the globe
• Hired directly by EPAM & 100% under payroll
• Law benefits (IMSS, INFONAVIT, 25% vacation bonus)
• Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members)
• 13 % employee savings fund, capped to the law limit
• Grocery coupons
• 30 days December bonus
• Employee Stock Purchase Plan
• 12 vacations days plus 4 floating days
• Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st)
• Monthly non-taxable amount for the electricity and internet bills

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM's Privacy Notice and Policy.