Software Developer/Data Engineer

Software Developer/Data Engineer at Boardroom Appointments in South Africa.

Role Summary

• Software Developer/Data Engineer - 12 Month Contract
• Educational Qualifications
• BSc Computer Science / BEng
• Professional Qualifications
• AWS Professional Certification
• Years of Experience
• 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
• Skills / Requirements
• 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
• Required to code complex transformations using loader specifications provided by the BA
• Experience working with Big Data sets and solving data-related challenges
• Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue
• Proficiency in coding languages: PySpark, Python, SQL
• Hands-on experience with AWS services , including S3, Athena, Lambda Functions, GLUE, EC2
• AWS experience and AWS certification required
• Experience in data modeling and data architecture design

Responsibilities

• Implement scalable data pipelines and architectures using PySpark, Python, SQL
• Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue
• Serve as a technical resource for team members and mentor junior engineers
• Collaborate with the team to deliver high-quality solutions that meet business requirements
• Ensure code is well-designed, maintainable, and follows best practices and standards
• Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met
• Utilize project development tools such as JIRA, Confluence, and GIT
• Assist DEVOPS Engineer in automation and CI/CD practices

Evaluate and recommend new technologies to improve performance, scalability, and reliability of software systems.

About the Company

We're not your average tech company we're a rocket-fueled, innovation-driven powerhouse that's changing the game. Our mission? To bring together the most incredible tech talent with companies that are shaping the future. We're talking AI, IoT, blockchain, and all the mind-blowing buzzwords you can think of!