Senior AWS Data Engineer | Remote - 135667 (Alphaville - Barueri, BR, 06.4

Role Summary

We are looking for a person who

• Enjoy working as a team and be collaborative in your assignments;
• Have the courage to challenge yourself and go further, embracing new opportunities for growth;
• Transform ideas into creative solutions and seek quality throughout your routine;
• Have problem-solving skills;
• Have the ability and feel comfortable working independently and managing your own time;

Be interested in dealing with adverse and innovative situations in the technological field.

Big enough to deliver – small enough to care.

• #VempraGFT
• #Let'sFlyTogether
• #ProudToBeGFT

Responsibilities

• Manage schemas, backups, read replicas and parameter groups, in addition to developing efficient SQL.
• Create queries in SQL and NoSQL databases, defining the appropriate paradigm for each need.
• Develop Glue Jobs, configure crawlers and run Spark Jobs on EMR.
• Create transformations in Spark/PySpark for reading and writing in various sources.
• Create and query Iceberg/Delta tables using time travel and snapshots.
• Optimize queries in Athena through partitioning, columnar formats, and workgroups.
• Manage data and permissions in Lake Formation.
• Create schemas, load data (COPY), develop analytical queries and manage users in Redshift.
• Develop DAGs in Airflow, configure connections and schedule workflows.
• Implement lineage, cataloging, data classification, access controls, schema validations and versioning.
• Implement ElastiCache, cache-aside and TTLs clusters.

Mandatory Requirements

• Knowledge of Redis and Memcached, cache concepts and usage criteria.
• Experience with relational banks, RDS and SQL and NoSQL paradigms.
• Knowledge of ETL, AWS Glue, EMR and distributed processing with Apache Spark.
• Experience with ACID in Data Lakes, open formats, Athena, Lake Formation and data governance.
• Knowledge of MPP and Redshift Data Warehouse.
• Familiarity with Airflow, DAGs, data lineage, traceability, security, compliance, Lakehouse and Data Contracts.

Requirements

What we look for

Senior level professional who works with (Data/AWS).

Desirable

• Experience in cache architecture and optimization, connection pooling, Multi-AZ failover, performance tuning, IAM and encryption.
• Modeling oriented towards access patterns, consistency strategies and query optimization.
• Advanced knowledge in Glue, EMR, Spark, Data Quality, schema evolution and Iceberg, Delta and Hudi formats.
• Experience with Athena, Glue Catalog, Lake Formation, granular permissions and cross-account sharing.
• Advanced knowledge in Redshift, materialized views, workload management and data sharing.
• Development of complex DAGs, MWAA, custom operators, retries and observability.
• Experience in data governance, lineage, metadata, quality metrics, Data Contracts and schema registries.