SR Data Engineer - Pipeline

Role Summary

At Stefanini Group, we believe in the power of collaboration. We co-create innovative solutions in partnership with our clients, combining cutting-edge technology, artificial intelligence and human creativity. We are at the forefront of solving business problems, delivering real impact on a global scale.

When you join Stefanini, you become part of a global journey of transformation. We are committed to creating a positive impact not only on the business, but also on the lives of our employees. If you are looking for an opportunity for professional growth in a company that values innovation, respect, autonomy and partnership, you will find it here!

Join us and be part of the change!

What we need you to know

• Higher education in the area of Information Technology or higher education with a postgraduate course in the area of IT;
• Practical knowledge of databases and SQL language;
• Practical knowledge of multidimensional databases;
• Knowledge of ETL — Extract, Transform, Load;
• Familiarity with data structures and the content of analytical data sources, such as data warehouse and data mart;
• General knowledge in Business Intelligence;
• Analytical capacity;

Mastery of Microsoft Power BI tools.

Responsibilities

What we hope you accomplish

• Model and enable data flows, including ETL — Extract, Transform, Load —, ELT — Extract, Load, Transform — and data streaming processes;
• Develop and maintain data pipelines that ensure the efficient and reliable movement of information between systems;
• Perform tests and implement tools to automate and optimize data processing in real time and in batch, ensuring the integrity and quality of information throughout the entire life cycle;
• Use Python for data manipulation, especially with the Pandas, NumPy, PySpark, PySpak, Polars, DuckDB and SQLAlchemy libraries, or similar;
• Work on Machine Learning projects, especially with tools such as Airflow, Spark, Flink, Kafka and Parquet, among others.

Requirements

Desirable requirements

• Experience in modeling and enabling data flows, including ETL — Extract, Transform, Load —, ELT — Extract, Load, Transform — and data streaming processes;
• Experience in developing and maintaining data pipelines that ensure the efficient and reliable movement of information between systems;
• Experience in carrying out tests and implementing tools to automate and optimize data processing in real time and in batches, ensuring the integrity and quality of information throughout the entire life cycle;
• Advanced knowledge of Python for data, especially Pandas, NumPy, PySpark, PySpak, Polars, DuckDB and SQLAlchemy libraries, or similar;
• Advanced knowledge in Machine Learning projects, especially with tools such as Airflow, Spark, Flink, Kafka and Parquet, among others.

Benefits

• 🍛 Food vouchers or meal vouchers;
• 👨🏼🎓 Discount on language courses, universities and institutions;
• 📚 Stefanini Academy — platform with free, updated and certified online courses;
• 🗣 Mentoring;
• 💉 Benefits club for consultations and exams;
• 🏥 Medical assistance;
• 🦷 Dental assistance;
• 💰 Advantages and discounts club in the best establishments;
• 🛫 Travel club;

🐶 Agreement for pets.