Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Data Engineer

 Job Description:

My client is one of the leading digital banks in Malaysia.

Job Responsibilities:

  • Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
  • Implement data ingestion, transformation, and validation processes in Python to support:
  • Loan collection tracking and reporting
  • Card payment settlement workflows
  • Merchant transaction analysis
  • Daily/periodic balance snapshot generation
  • Customer loyalty and rewards analytics
  • Collaborate closely with product managers, backend engineers, and analysts to ensure data pipelines align with business requirements.
  • Monitor, troubleshoot, and optimize data workflows to ensure high performance and reliability.
  • Enforce data quality standards and contribute to data governance processes.
  • Participate in code reviews and technical design discussions.
  • (Optional) Enhance backend data services or processing logic using Java when applicable.
  • Stay informed of the latest trends in data engineering to continuously improve pipeline efficiency and robustness.

Job Requirements:

  • Proven experience as a Data Engineer in a production environment.
  • Strong expertise in Apache Airflow for workflow orchestration.
  • Proficiency in Python for data processing tasks.
  • Solid understanding of SQL and experience working with relational databases (e.g., PostgreSQL, MySQL).
  • Familiarity with ETL/ELT best practices and data modeling concepts.
  • Experience working in agile, product-focused teams.
  • Ability to manage multiple pipelines and prioritize tasks effectively.