Reporting and Analytics Developer/Data Engineer 0910

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 4 years of experience managing data engineering jobs in big data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs. The candidate will also be integrating data sets to provide seamless data access to users.

The developer is responsible to:

i. Analyse the Authority's data needs and document the requirements.

ii. Refine data collection/consumption by migrating data collection to more efficient channels

iii. Plan, design, and implement data engineering jobs and reporting solutions to meet the analytical needs.

iv. Develop test plan and scripts for system testing, support user acceptance testing.

v. Work with the Authority's technical teams to ensure smooth deployment and adoption of new solution.

vi. Ensure the smooth operations and service level of IT solutions.

vii. Support production issues

Skill Set and Track Record:

i. Tertiary Education in relevant fields is preferred.

ii. Good understanding and completion of projects using waterfall/Agile methodology.

iii. Analytical, conceptualisation and problem-solving skills.

iv. Good understanding of analytics and data warehouse implementations

v. Hands-on experience in big data engineering jobs using Python, Pyspark, Linux, and ETL tools like Informatica

vi. Strong SQL and data analysis skills. Hands-on experience in data virtualisation tools like Denodo will be an added advantage

vii. Hands-on experience in a reporting or visualization tool like SAP BO and Tableau is preferred

viii. Track record in implementing systems using Cloudera Data Platform will be an added advantage.

ix. Motivated and self-driven, with ability to learn new concepts and tools in a short period of time

x. Team player with ability to collaborate and work effectively within team

· Good written and verbal communication and interpersonal skills, ability to communicate confidently with stakeholders

xi. Passion for automation, standardization, and best practices

xii. Good presentation skills are preferred