Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Data Engineer
Job Description:
My client is one of the leading digital banks in Malaysia.
Job Responsibilities:
- Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
- Implement data ingestion, transformation, and validation processes in Python to support:
- Loan collection tracking and reporting
- Card payment settlement workflows
- Merchant transaction analysis
- Daily/periodic balance snapshot generation
- Customer loyalty and rewards analytics
- Collaborate closely with product managers, backend engineers, and analysts to ensure data pipelines align with business requirements.
- Monitor, troubleshoot, and optimize data workflows to ensure high performance and reliability.
- Enforce data quality standards and contribute to data governance processes.
- Participate in code reviews and technical design discussions.
- (Optional) Enhance backend data services or processing logic using Java when applicable.
- Stay informed of the latest trends in data engineering to continuously improve pipeline efficiency and robustness.
Job Requirements:
- Proven experience as a Data Engineer in a production environment.
- Strong expertise in Apache Airflow for workflow orchestration.
- Proficiency in Python for data processing tasks.
- Solid understanding of SQL and experience working with relational databases (e.g., PostgreSQL, MySQL).
- Familiarity with ETL/ELT best practices and data modeling concepts.
- Experience working in agile, product-focused teams.
- Ability to manage multiple pipelines and prioritize tasks effectively.