Data Engineer
Job Description:
We are seeking a skilled Data Engineer to join our growing Tech & Data team at mGanik. The ideal candidate will design, build, and maintain the infrastructure for data generation, processing, and storage while ensuring optimal data flow and access. The candidate should be passionate about leveraging data to drive business insights and improvements.
Key Responsibilities:
- Design, construct, install, and maintain scalable data pipelines to handle large datasets.
- Develop and manage ETL processes for data integration from diverse sources.
- Collaborate with the tech team and data analysts to understand data requirements and deliver solutions.
- Optimize data systems and pipelines for performance and reliability.
- Monitor and troubleshoot data pipeline issues and optimize for high availability.
- Ensure compliance with data governance and security policies.
- Stay up-to-date with industry trends and emerging technologies related to data engineering.
Qualifications:
- Bachelors degree in Computer Science, Engineering, or a related field.
- 2+ years of experience in data engineering or a related field.
- Proficiency in programming languages such as Python, Java, R or Scala.
- Experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
- Knowledge of data pipeline tools (e.g., Apache Kafka, Apache Airflow, AWS Glue).
- Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) , GitHub and data warehousing solutions (e.g., Snowflake, Redshift).
- Strong understanding of data modeling, data architecture, and data integration concepts.
- Ability to communicate and collaborate with multiple teams and third party vendors.
Preferred Skills:
- Experience with machine learning and data analytics tools.
- Familiarity with container technologies (e.g., Docker, Kubernetes).
- Knowledge of data visualization tools (e.g., Looker, Metabase, Tableau).
- Understanding of Agile methodologies.
What We Offer:
- Competitive salary and benefits package.
- Opportunities for professional development and growth.
- A collaborative and innovative work environment.
Required Skills:
Compliance Cassandra Data Warehousing Scala Apache Kafka High Availability Snowflake Analysts Modeling Azure Pipelines Agile Data Modeling NoSQL Apache Visualization AWS Salary Data Visualization Data Analytics Agile Methodologies Programming Languages Reliability Storage Architecture Machine Learning R Kubernetes Analytics Infrastructure Availability Tableau PostgreSQL Github Programming MongoDB Integration Docker Databases Computer Science Security Vendors MySQL Java Python SQL Design Engineering Business Science