Senior Data Engineering Analyst - Affirmative Vacancy for Women

Role Summary

We work in the Data Office of the largest DataTech on the market, building complex data flows and highly resilient pipelines. The professional will work directly on the evolution of data pipelines, supporting the transformation of legacy processes to a more scalable and resilient cloud solution, building new Data Products and applying complex data transformations using various Cloud tools and technologies.

This position will support the data quality team with quality monitoring applications and building Dashboards, as well as the data flows to make these solutions possible. You will also have contact with large-scale data ingestion, cleaning and prioritization flows.

Responsibilities

• Develop and maintain scalable and efficient data pipelines in PySpark;
• Migrate and modernize legacy processes to new distributed processing models;
• Implement data processing solutions in an AWS environment;
• Collaborate with product teams and Data Office analysts to detail business needs and rules;
• Optimize data architectures considering performance, governance and cost;

Participate in automation, observability and continuous process improvement initiatives.

Requirements

Technical Requirements

• Complete higher education;
• Solid experience with PySpark and distributed processing frameworks;
• Knowledge of Apache Airflow, Spark and Hadoop (when applicable);
• Proficiency in programming languages, preferably Python;
• Experience with relevant AWS services (e.g. EMR, Lambda, DynamoDB, S3, Glue optional);
• Knowledge of SQL databases;

Familiarity with DevOps practices and CI/CD pipelines.

• Differences
• Experience with infrastructure provisioning (IaC);
• Experience with agile methodologies;
• Previous experience in migrating legacy processes to distributed architectures.
• Applied knowledge of Machine Learning and AI Agent Architecture.
• Behavioral Skills
• Ability to deal with complex problems and understand business rules;
• Critical sense and focus on efficiency;
• I like optimization and continuous improvement;
• Clear communication and effective collaboration with different areas;
• Results-oriented mentality;
• Fast learning and adaptability to technological changes.
• This is an affirmative stance for women, as part of our commitment to advancing gender equity in the workplace.
• Serasa Experian invests in female leadership and has a partnership with TODAS Group. Furthermore, we join the 'They Lead 2030' Movement, and we join UN Women to reduce gender inequality by 2030!!
• We also have the Women in Experian group that seeks to improve gender equity for women, creating development opportunities, different perspectives, skills, among others.
• Come be part of this transformation!
• If you don't identify with this group, we invite you to explore other opportunities on our careers page. We have several vacancies that may connect with your profile and interests.
• Experian Careers - Creating a better tomorrow together
• Find out what its like to work for Experian by clicking here

Experian is a global data and technology company that drives opportunities for people and businesses around the world. We operate in several markets, such as financial services, health, automotive, agribusiness, insurance, among others. Experian invests in people and advanced new technologies to unlock the power of data. We have an incredible team of 25,200 employees in 32 countries.

Our uniqueness is to value yours. Experian’s people-centered, inclusive and purpose-driven culture is recognized by numerous awards — including World’s Best Workplaces™ 2025 (Fortune’s Global Top 25) and Great Place To Work™ in 26 countries, among others. Check out Experian Life on social media or explore our careers site to see why. Experian is also proud to be an equal opportunity and affirmative action employer.