HongKong, Hong Kong

Data Engineer

 Job Description:

Background:

As a Data Engineer (Platform) you will develop, maintain, test and evaluate data platform solutions within our next generation Data and Analytics Platform. Data

Engineers are involved in the design of data solutions matching capabilities to priority business challenges.

Key Responsibilities:

1. Building and enhancing data platform solutions including data virtualization,

data visualization and data lake

2. Conduct data platform proof-of-concept and acceptance testing

3. Develop services and integrate them with internal and external APIs

4. Identify and evaluate new technologies that improve performance,

maintainability and scalability of our infrastructure.

5. Work closely with Architects, Platform Engineers and Product Owners to

deliver software in a continuous delivery environment.

Qualifications:

  • University degree in computer science, software engineering, or related fields
  • At least 3 years of experience in data platform development
  • Experience in delivery of large scale data infrastructure (in scale of hundreds of TB) is highly desired
  • Experience in system design and Infrastructure as Code (IaC) is a must
  • Experience in designing, implementing and managing DevOps pipelines in a large scale enterprise environment is preferred - - - - - - -
  • Experience in public cloud platforms (AWS, Azure, AliCloud) and having any relevant certification is a plus 
  • Experience of implementing data security capabilities such as encryption, anonymization is a plus
  • Experience with bash scripting for automation and system integration
  • Experience in the following technology stack
  • Programming skills, in any one of these programming language (Java, Nodejs, Python)
  • Scripting: Bash script or PowerShell
  • CICD Suite: Jenkins, JIRA, Sonar, Git, Ansible
  • Test Framework: jMeter, jUnit, PyTest
  • Data Engineering: Airflow, Spark
  • Data Lake Framework: Apache Hudi / Iceberg / Delta Lake
  • Infrastructure: Docker, Terraform, Kubernetes
  • Experience in working in an international team, with solid grounding in financial service is a plus
  • Excellent communication skills and data driven thinking capabilities
  • Team management and problem-solving skills; self-motivated, creative, and with a proven track record in developing and driving firm-wide initiatives