DATA ENGINEER

KEY RESPONSIBILITIES:

• Design, construct, and maintain data pipelines for data ingestion, transformation, and storage
• Ensure data integrity, quality, and security throughout the data lifecycle.
• Optimize data processing workflows for performance and scalability.
• Collaborate with data scientists and analysts to facilitate data accessibility.

QUALIFICATIONS:

• 5+ years of experience in a data engineering or data platform role.
• Strong experience with Azure Databricks, Data Lake Storage, PySpark, and Jupyter Notebooks.
• Proficiency in SQL, Python, and distributed data processing frameworks.
• Experience working with Azure Data Factory, Azure Synapse, or similar ETL/ELT tools.
• Understanding of data governance, privacy, and security best practices.
• Familiarity with supporting ML/AI workflows, including data preparation for machine learning pipelines.
• Excellent problem-solving and communication skills

Vertical

Technology