ART 1284 Data Engineer

Responsibilities:

• Develop and maintain data pipelines and ETL/ELT processes, and ensuring maintainability through unit and integration testing.
• Collaborate with data teams to understand requirements and automate deployment and monitoring.
• Optimize data storage and troubleshoot issues to enhance performance.

Skillset:

• Possess a degree in Computer Science/Information Technology or related fields.
• At least 5 years of relevant working experience in software or data engineering with proficiency in Python.
• Strong experience in unit and integration testing.
• Familiarity with DevOps practices and Agile methodologies.
• Strong software engineering, analytical and problem-solving skills.
• Experience in AWS and Kubernetes (K8s).
• Familiarity with data platforms such as Snowflake, Apache Spark, or Apache Hive, as well as orchestration tools like Apache Airflow, Dagster, or Prefect.
• Familiarity with GitHub workflows and Datadog.