Data Engineer Sr (Azure)

We are seeking a highly skilled and motivated Data Engineer with expertise in Azure Synapse to join our team. The ideal candidate will have a strong background in designing and implementing scalable and efficient data pipelines, data warehousing solutions, and ETL processes using Azure Synapse. The role requires a deep understanding of big data technologies, data modeling, and proficiency in optimizing data storage and processing for large-scale analytics.

Key Responsibilities:

Data Pipeline Development:

Design, develop, and maintain robust and scalable data pipelines using Azure Synapse to extract, transform, and load (ETL) data from various sources into the data warehouse.

Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into efficient data processing workflows.

Azure Synapse Development:

Utilize Azure Synapse's features and capabilities to create optimized data storage structures, including data lakes and data warehousing solutions.

Implement best practices for data partitioning, indexing, and optimization to ensure high performance and low latency in data retrieval.

Data Modeling and Optimization:

Work closely with data architects to design and implement data models that support business requirements and ensure data accuracy, consistency, and reliability.

Continuously monitor and optimize data pipelines and queries to improve performance and reduce costs, using tools and techniques available in Azure Synapse.

Collaboration and Communication:

Collaborate effectively with cross-functional teams, including data scientists, analysts, and software developers, to understand data requirements and provide appropriate data solutions.

Communicate complex technical concepts and solutions to non-technical stakeholders in a clear and understandable manner.

Documentation and Best Practices:

Create comprehensive documentation for data pipelines, data models, and technical processes, ensuring that best practices and standards are followed.

Stay up-to-date with the latest advancements in Azure Synapse and related technologies, incorporating new features and best practices into the data engineering processes.

Qualifications:

Proven experience in designing and implementing data solutions using Azure Synapse, Azure Data Factory, Azure Databricks, and other relevant Azure services.

Strong proficiency in SQL and experience with programming languages such as Python, Scala, or Java for data manipulation and transformation.

Solid understanding of data warehousing concepts, data modeling, and ETL processes.

Familiarity with big data technologies and frameworks like Hadoop, Spark, and Hive.

Excellent problem-solving skills and ability to troubleshoot complex data-related issues.

Strong communication skills and ability to work collaboratively in a team environment.

Azure certifications related to data engineering and analytics are a plus.


CVs a talento@darwoft.com

Stop, si necesitas algo
Hernán Vietto (clic en mí y lo resolvemos juntos).