Sr. Data Engineer

Experience: 5+ Years

Job Location: Remote

No. of Positions: Multiple

Qualifications: BE/B Tech, ME/MTech, MCA or Higher

Work Timings: 1:30 PM IST to 10:30 PM IST

Functional Area: Database Development

We are looking for a Senior Database Engineer/Data Engineer (Azure) with strong experience in Azure cloud, advanced SQL skills, and hands-on expertise in building scalable data pipelines and database solutions. The role involves end-to-end data engineering, performance tuning, Azure development, and ensuring secure, reliable, and optimized data workflows.

Key Responsibilities

• Design and maintain relational database schemas and optimize SQL queries, stored procedures, and scripts.
• Build, optimize, and maintain dynamic and parameterized Azure Data Factory (ADF) pipelines with robust error handling and retry logic.
• Develop scalable data processing workflows using Azure Databricks & PySpark.
• Work on Azure Synapse Analytics and write advanced T-SQL queries for data validation across SQL Server and Synapse.
• Manage ADLS Gen2 with Delta Lake / Lakehouse design (Bronze/Silver/Gold layers).
• Perform performance tuning for SQL queries and Spark jobs.
• Implement and maintain CI/CD pipelines using Azure DevOps/Git for version-controlled, unified deployments.
• Work with Service Principals and Managed Identities for secure access.
• Monitor and troubleshoot database and pipeline performance.
• Administer SQL Server / PostgreSQL, ensuring high availability, security, and DR processes.
• Support modernization and cloud migration initiatives (e.g., SSIS to Azure).
• Collaborate with cross-functional teams across applications, analytics, and data engineering.

Required Skills & Experience

• 5+ years of experience in Data Engineering / Database Development.
• Strong proficiency in SQL Server or PostgreSQL; expertise in T-SQL and query optimization.
• Hands-on expertise in ADF, Azure Databricks, PySpark, and Azure Synapse.
• Solid understanding of ADLS Gen2, Delta Lake, and Lakehouse architecture.
• Experience with CI/CD using Azure DevOps/Git.
• Knowledge of Service Principals and Managed Identities.
• Strong performance tuning skills (SQL + Spark).
• Experience working with international clients (USA/Europe).
• Excellent analytical and communication skills.