M17 - Data Engineer

Responsibilities

• Evaluate and coordinate data requests from business users, understanding requirements and recommending suitable datasets based on business objectives
• Assess data availability and provide clear guidance to help users navigate HPB's data ecosystem
• Collaborate with requestors, data operations teams, and domain data engineers to ensure timely fulfilment of approved data requests
• Design and implement data extraction and delivery processes while maintaining data accuracy, security, and governance standards
• Manage recurring data contributions to government partners, ensuring compliant and timely delivery
• Ensure all data services adhere to established governance frameworks and access control standards
• Curate and maintain metadata for HPB's data discovery platform to improve dataset discoverability and usability
• Work closely with data owners and engineering teams to improve metadata quality and maintain accurate data catalogues
• Enhance dataset descriptions, classifications, and catalogue information to improve organisational data accessibility
• Provide Level-1 support through the CDOO service management system, including triaging and user guidance
• Identify and implement process improvements to enhance service quality, reduce turnaround time, and improve user experience
• Maintain operational documentation and knowledge repositories to support service continuity and operational excellence

Requirements

Experience & Education

• Minimum 2 years of experience in data engineering, data operations, analytics support, data integration, or metadata management
• Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Data Analytics, or related discipline from a recognised institution
• Candidates with relevant professional certifications in data engineering, analytics, or data science, together with relevant experience, may also be considered

Technical Skills

• Hands-on experience with SQL, PySpark, and/or Python for structured datasets and data transformation
• Familiarity with cloud-based data platforms, preferably Microsoft Azure, including Databricks and enterprise data warehouse environments
• Understanding of data governance, metadata management, and data catalogue concepts

Core Competencies

• Strong stakeholder management and communication skills
• Analytical and problem-solving mindset with a service-oriented approach
• Ability to translate business requirements into practical data solutions
• Strong attention to detail and commitment to operational excellence

Nice to Have

• Experience with Microsoft Purview and Unity Catalog
• Professional certifications in cloud, data engineering, data governance, or analytics domains