Senior Data Engineer

EMPLOYMENT TYPE:

6-month contract, with a high possibility of extension based on performance.

COMPANY:

At Vito Solutions, we build smart, scalable tech solutions that help companies grow faster. From startups to corporates, we've been solving complex IT challenges since 2013, so our clients can scale without setbacks.

CLIENT:

A leading global consulting firm.

LOCATION:

Johannesburg, South Africa

WORKING MODEL:

Hybrid

JOB OVERVIEW:

The Senior Data Engineer will be responsible for designing, implementing, and maintaining scalable data solutions to support enterprise analytics, reporting, and data science initiatives. The role demands deep expertise in Azure-based cloud architecture, data modelling, and modern data engineering practices, including the Medallion architecture. This individual will play a key role in the development and governance of robust, secure, and efficient data pipelines and platforms.

DESCRIPTION OF POSITION:

The Senior Data Engineer will:

• Architect and implement data solutions using the Medallion architecture framework.
• Design and develop efficient data models to support BI, analytics, and ML use cases.
• Build, maintain, and optimise data pipelines in Azure, leveraging Azure Fabric and other native services.
• Oversee data integration strategies across various systems, ensuring reliable ingestion and transformation processes.
• Manage and monitor DBMS performance, performing tuning and administrative tasks as needed.
• Contribute to continuous integration and delivery (CI/CD) practices for data solutions.
• Collaborate with cross-functional teams, including data scientists, analysts, and software engineers.
• Ensure compliance with data governance, lineage, and metadata standards using tools like Azure Purview.
• Lead troubleshooting and root cause analysis of data-related issues across environments.

KNOWLEDGE AND SKILLS:

• Strong understanding of Medallion architecture and modern data engineering frameworks.
  
• Expertise in data modelling and database design (relational and non-relational).
  
• Deep knowledge of Azure cloud services, especially MS Fabric, Azure Data Lake, Azure Synapse, and related tools.
  
• Proficiency in Python for data engineering and scripting tasks.
  
• Familiarity with CI/CD pipelines in a data environment.
  
• Experience working with Databricks and Spark-based processing.
  
• Knowledge of metadata management and data cataloguing tools such as Azure Purview.
  
• Solid understanding of DBMS systems and their administrative functions.
  
• Experience in designing and implementing data integration solutions using various patterns (batch, streaming, APIs, etc.)
  

QUALIFICATIONS REQUIRED:

Bachelor's Degree in Computer Science, Information Systems, Engineering, or a related field.

EXPERIENCE REQUIRED:

• Minimum of 5-7 years of experience in data engineering or a similar role.
  
• Hands-on experience with Azure-based data platforms and services.
  
• Proven experience designing and implementing data solutions using Medallion architecture.
  
• Experience with Databricks, Python, and CI/CD implementation in data environments.
  
• Practical experience with data integration and orchestration tools and methods.
  
• Demonstrated knowledge of managing and administering large-scale DBMS.
  

ADVANTAGEOUS SKILLS:

• Microsoft Azure certifications (e.g. Fabric Data Engineer Associate).
• Experience in implementing data security best practices within Azure environments.
• Familiarity with machine learning workflows and supporting infrastructure.
• Exposure to Agile/Scrum methodologies in a data-driven team.
• Experience with infrastructure as code (IaC) for data environments.

**Please note: If you have not heard from us within 2 weeks, please consider your application unsuccessful.