Job Openings Senior Python & Data Engineer

About the job Senior Python & Data Engineer

Job brief

Are you an experienced Data Engineer looking for your next challenge? Join ASAP! Be part of a high-impact project migrating legacy ETL jobs to a cutting-edge Airflow + Databricks architecture. This is a remote opportunity for top talent in Latin America!


Requirements

  • 10+ Years
  • 8+ years of data engineering experience.
  • 4+ years with Python
  • 4+ years in Airflow
  • 4+ years in Databricks and PySpark
  • 2+ years in AWS Glue
  • 2+ years in Snowflake
  • 4+ years with SQL. Some NoSQL
  • Experience processing large datasets.
  • CI/CD experience (Git, Jenkins).
  • Experience with databases (Oracle, Redshift, Aurora).
  • AWS Compute, Database, and Management tools experience.
  • Skills Required - ETL, data flows, ingestion, reporting, analytics, general communication and technical troubleshooting.
  • Primary Technology Stack - AWS, Glue, Snowflake, Airflow, Databricks, ETL, Lambda
  • Primary Responsibilities - The role is to help migrate a number of old ETL jobs (Lambda, Glue, Snowlfake) into the customers new ETL standard (Airflow+Databricks). The consultants would be part of the broader customer team executing this project, but still be expected to be able to operate independently. 
  • Java/Spring Boot web app development experience. (Good to have)
  • Microservices/RESTful API experience. (Good to have)
  • AWS Certification/Cloud migration experience. (Good to have)