Senior Data Engineer (M/F)

Tech Lead Data Engineering

Position Overview:
As a Tech Lead Data Engineering, you will act as the key technical advisor for stakeholders, take ownership of data engineering projects, manage technical debt, and mentor junior team members. You will contribute to architecture, design, and development of robust data solutions.

Key Responsibilities

• Lead the design and development of batch and real-time data pipelines using tools like Databricks, PySpark, and DBT.
• Optimize data storage formats (e.g., Delta Lake, Parquet) and implement data quality checks.
• Collaborate with data scientists and analysts to provide seamless access to data for analytics and machine learning.
• Manage Azure cloud infrastructure and ensure compliance with data privacy regulations.
• Mentor junior team members and promote best practices in data engineering.

Requirements:

• Masters or PhD in a related field.

• 5+ years of experience in data engineering with expertise in Azure, Databricks, and Python.

• Strong skills in data architecture, ETL processes, and cloud infrastructure management.

• Experience with CI/CD tools and data security best practices.