G07 - Data Engineer

What you will be working on:

• Architect and build ingestion pipelines to collect, clean, merge, and harmonize data from different source systems.
• Translate data requirements from business users into technical specifications.
• Work with Agency's project teams to develop user stories, functional/technical specifications and acceptance criteria
• Design and build secure mechanisms for end users and systems to access data in data warehouse.
• Research, propose and develop new technologies and processes to improve agency data infrastructure.
• Implement data quality checks and validation processes to ensure data accuracy and consistency
• Review data pipelines to ensure adherence to data management standards, policies and procedures.
• Analyse impact of requested changes and propose improvements to continuously address changing business needs, and work with support team to understand and address technical problems (Operations & Maintenance phase)

What we are looking for

• Diploma/Degree in Computer Science, Infocomm Technology, Computer or Electronics Engineering or related subject area with minimum 3 years of relevant experience.
• Data manipulation using scripting languages like Python or using ETL tools Visual analytics technologies like Tableau, Power BI End-to-end analytics architecture, preferably with some working knowledge of big data stack

• Experience with SQL/NoSQL databases

• Experience in AWS Cloud especially Glue and RedShift

• Experience working with CI/CD setups

• Strong knowledge of algorithms and database structures

• Strong knowledge of database integration and migration strategy

• Strong knowledge in designing and implementing scalable data infrastructure