Azure Databricks Engineer-10799819

Location: Amsterdam, Netherlands
Work Model: Onsite
Contract Duration: 5 Months
Start Date: July 2026
Experience Required: 6–8 Years

Role Overview

We are seeking an experienced Azure Databricks Engineer with strong expertise in Python, PySpark, and SQL to design, develop, and maintain robust data processing solutions within a Databricks environment. The ideal candidate will have deep hands-on experience building scalable, reliable, and maintainable data platforms, with a strong focus on data processing rather than traditional BI or data enrichment solutions.

Key Responsibilities

• Design, develop, and optimize data processing solutions using Azure Databricks.
• Build and manage batch and streaming data pipelines.
• Design effective data models within the Databricks ecosystem.
• Manage multiple parallel data processing workloads on shared source data.
• Develop high-quality solutions using Python, PySpark, and SQL.
• Implement CI/CD pipelines using Azure DevOps and YAML-based deployment processes.
• Utilize Infrastructure as Code (IaC) practices with ARM templates and Bicep.
• Ensure solution reliability, scalability, maintainability, and performance.
• Collaborate with cross-functional teams in an Agile environment.
• Continuously improve existing architectures while minimizing technical debt.

Required Skills

• Strong hands-on experience with Azure Databricks.
• Advanced proficiency in Python, PySpark, and SQL.
• Experience designing and managing data processing architectures in Databricks.
• Expertise in handling both streaming and batch data workloads.
• Strong understanding of Azure cloud services.
• Experience with CI/CD implementation using YAML pipelines.
• Knowledge of Infrastructure as Code (ARM Templates and Bicep).
• Experience working in Agile delivery environments.

Preferred Skills

• Understanding of end-to-end data platform and data engineering solutions.
• Experience working within complex and evolving data architectures.

Desired Qualities

• Strong focus on quality, reliability, and maintainability.
• Pragmatic engineering mindset with practical decision-making abilities.
• Proactive approach to continuous improvement.
• Excellent communication and collaboration skills.
• Structured working style with an emphasis on avoiding unnecessary complexity and technical debt.

Ideal Candidate Profile

The ideal candidate is a hands-on Azure Databricks specialist with deep practical expertise in managing and controlling data processing within Databricks environments. They should be capable of building stable, scalable solutions while making sound technical decisions in complex enterprise data ecosystems.