Data Engineer
Job Description:
What you will be working on:
- Involve in the design and building of resilient and efficient data pipelines for both batch and real-time streaming data
- Involve in the architecture and design of data infrastructure on cloud using industry standard Infrastructure-as-Code tools
- Execute projects with an Agile mindset
- Build software frameworks to solve data problems at scale
- Collaborate with product managers, software engineers, data analysts and data scientists to build scalable and data-driven platforms and tools
- Be put in the driving seat as an engineering leader
What we are looking for:
- Bachelors Degree in Computer Science or have equivalent professional experience
- Have at least 3 years of experience in a technical leadership and management role
- Experience with data processing tools such as Spark, Beam, Flink
- Experience with the cloud (e.g. AWS, GCP, Azure)
- Experience implementing batch and streaming data pipelines
- Experience writing efficient SQL
- Knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
- Familiar with DevOps tools such as Git, Docker, Terraform
- Experience in leading and managing teams
- Experience in developing the capabilities of engineers by providing effective mentorship and training opportunities
- Experience in the public sector is a bonus
- Keep the team aligned using project management systems to track task progress and recalibrating as necessary
- Ability to identify bottlenecks and roadblocks in engineering processes and clear them