Senior Data Engineer

Mission for this role

As the senior data engineer at NocNoc, you will play a crucial role in maintaining and improving the highly reliable and scalable data platform as the foundation of the company's data strategy. You must be self-directed and comfortable supporting the needs of multiple teams, systems, and products. You should be excited by the prospect of applying modern data stack and emerging technologies to drive our data platform and data initiatives.

Responsibilities:

• Design, create and maintain the new and existing optimal data pipelines to efficiently ingest, clean, transform, and aggregate data from various sources
• Design and implement dimensional data models in data warehouse and data mart
• Optimize data pipeline performance to maintain the speed,reliability and scalability
• Contribute to the development of in-house ETL framework
• Develop data platform tools for data quality, data observability and data management
• Maintain, optimize and improve an existing data platform features
• Design and implement additional data infrastructure upon product requests
• Research and introduce new data technologies to the team
• Collaborate with cross-functional teams including data analysts, data scientists, product managers and software engineers to identify data opportunities, involve in architecture design and support their data needs.

Qualifications:

• At least 4 years of experience in data engineer or related role
• Strong coding (Python, SQL) and testing skills and experience with common Python frameworks such as Poetry, pytest, and type hinters.
• Strong software development skill : Docker, Kubernetes, OOP, SOLID, TDD, CI/CD
• Experience with provisioning AWS services, infrastructure, network and security
• Experience with data orchestration tools e.g. Airflow
• Experience with distributed computing system e.g. Spark, Trino
• Knowledge of Infrastructure as a Code : Terraform
• Experience with relational databases and NoSQL e.g. MySQL, Postgres, MongoDB, Elasticsearch
• Knowledge of data lakehouse and open table format is a plus e.g. Iceberg, Hudi, Delta