WE ARE HIRING: Senior Data Engineer (Python – Data Pipelines)

Location: Sri Lanka
Employment Type: Full-time
Company Industry: IT

Role Overview

We are seeking an experienced and technically strong Senior Data Engineer to design, develop, and maintain data pipelines, backend data processing applications, and integration services within a fast-paced IT environment.

The selected candidate will be responsible for building reliable data processing workflows, integrating multiple data sources, implementing data transformations, ensuring data quality, and supporting scalable data movement into operational databases or data warehouses. This role requires strong Python, SQL, ETL, API integration, and data pipeline experience.

Key Responsibilities

Data Pipeline Development

• Develop data pipelines and backend data processing applications using Python.
• Build scalable ETL and data processing workflows to support business and operational needs.
• Integrate multiple data sources, including APIs, databases, and file-based inputs.
• Load processed data into operational databases or data warehouses.
• Ensure data workflows are reliable, efficient, and maintainable.

Data Transformation & Validation

• Implement data transformations, formulas, and business rules.
• Perform data mapping, validation, cleansing, and quality checks.
• Ensure data accuracy, consistency, and integrity across processing stages.
• Identify data issues and implement corrective actions where required.

Monitoring, Logging & Reliability

• Implement monitoring, alerting, and data validation frameworks to ensure pipeline reliability.
• Build scheduled jobs, logging mechanisms, and monitoring processes.
• Track pipeline performance and resolve processing failures or data inconsistencies.
• Support continuous improvement of data processing quality and reliability.

API & Integration Support

• Support lightweight API and integration services using Node.js / TypeScript.
• Work with REST APIs and file-based data ingestion processes.
• Assist in building and maintaining backend integration services.
• Collaborate with technical teams to ensure smooth data flow between systems.

Candidate Profile

• Minimum 4+ years of experience in Data Engineering, Data Integration, or Backend Data Processing.
• Strong experience in Python, including Pandas, FastAPI, or similar frameworks.
• Strong SQL and database knowledge.
• Experience building ETL / data processing pipelines.
• Experience integrating REST APIs and handling file-based data ingestion.
• Working knowledge of Node.js / TypeScript.
• Experience with NestJS will be an added advantage.
• Exposure to Airflow, Prefect, Cron, Docker, and cloud platforms will be preferred.
• Strong problem-solving and analytical skills.
• Good understanding of data quality, validation, and transformation logic.
• Ability to work in a fast-paced technical environment and meet deadlines.

Ready to take your career to new heights?

We're InTalent Asia, your go-to recruitment partner in Sri Lanka, and we've got an exciting opportunity for you! Our client is looking for a dynamic individual to fill the role of Senior Data Engineer (Python – Data Pipelines).

At InTalent Asia, we're not just recruiters; we're here to architect your career success. Join us in the journey of matching your skills with unparalleled opportunities.

Apply now and see how you can be the perfect fit for this exclusive position!

#InTalentAsia #CareerOpportunity #JobVacancy #SeniorDataEngineer #PythonJobs #DataEngineering #ITJobs #DataPipelines #ElevateYourCareer