Data Engineer

 Job Description:

What you will be working on:

    • Involve in the design and building of resilient and efficient data pipelines for both batch and real-time streaming data
    • Involve in the architecture and design of data infrastructure on cloud using industry standard Infrastructure-as-Code tools
    • Execute projects with an Agile mindset
    • Build software frameworks to solve data problems at scale
    • Collaborate with product managers, software engineers, data analysts and data scientists to build scalable and data-driven platforms and tools
    • Be put in the driving seat as an engineering leader

What we are looking for:

    • Bachelors Degree in Computer Science or have equivalent professional experience
    • Have at least 3 years of experience in a technical leadership and management role
    • Experience with data processing tools such as Spark, Beam, Flink
    • Experience with the cloud (e.g. AWS, GCP, Azure)
    • Experience implementing batch and streaming data pipelines
    • Experience writing efficient SQL
    • Knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
    • Familiar with DevOps tools such as Git, Docker, Terraform
    • Experience in leading and managing teams
    • Experience in developing the capabilities of engineers by providing effective mentorship and training opportunities
    • Experience in the public sector is a bonus
    • Keep the team aligned using project management systems to track task progress and recalibrating as necessary
    • Ability to identify bottlenecks and roadblocks in engineering processes and clear them