2x Senior Data Engineer – JHB

RESPONSIBILITIES:

• Design, build, and optimize data pipelines and architectures using Microsoft Azure technologies to support analytics, machine learning, and data-driven decision-making.
• Collaborate with data scientists, BI specialists, data analysts, and ICT application teams to deliver high-performance, scalable data solutions.
• Implement and manage ETL/ELT workflows in Azure Data Factory, Synapse Analytics, Databricks, and related tools.
• Develop and maintain data lakes and data warehouses to support enterprise reporting and analytics.
• Ensure data quality, security, and governance by implementing validation, monitoring, and access control frameworks.
• Maintain documentation and ensure adherence to data architecture standards and compliance requirements (e.g., POPIA, GDPR).
• Support automation and DevOps practices, including version control, CI/CD pipelines, and infrastructure-as-code.
• Provide technical input in budget planning, tool procurement, and cost optimization of cloud infrastructure.
• Participate in data-related forums, project committees, and ICT governance initiatives to promote collaboration and innovation.
• Stay abreast of advancements in cloud data engineering, share knowledge with the team, and lead the implementation of best practices.

REQUIREMENTS:

• Diploma/Degree (NQF Level 6) in Computer Science, Information Management Systems, or Data Science (Essential).
• 3 years managerial level and 5+ years experience in data engineering or a similar role (Essential).
• Strong expertise in Microsoft Azure, including:
• Azure Data Factory
• Azure Synapse Analytics
• Azure Databricks
• Azure Data Lake Storage (Gen2)
• Proficiency in SQL, data modeling, and data warehousing concepts.
• Hands-on experience with Python and/or R, including data processing (e.g., Pandas, PySpark).