Job Openings
Senior Python & Data Engineer
About the job Senior Python & Data Engineer
Job brief
Are you an experienced Data Engineer looking for your next challenge? Join ASAP! Be part of a high-impact project migrating legacy ETL jobs to a cutting-edge Airflow + Databricks architecture. This is a remote opportunity for top talent in Latin America!
Requirements
- 10+ Years
- 8+ years of data engineering experience.
- 4+ years with Python
- 4+ years in Airflow
- 4+ years in Databricks and PySpark
- 2+ years in AWS Glue
- 2+ years in Snowflake
- 4+ years with SQL. Some NoSQL
- Experience processing large datasets.
- CI/CD experience (Git, Jenkins).
- Experience with databases (Oracle, Redshift, Aurora).
- AWS Compute, Database, and Management tools experience.
- Skills Required - ETL, data flows, ingestion, reporting, analytics, general communication and technical troubleshooting.
- Primary Technology Stack - AWS, Glue, Snowflake, Airflow, Databricks, ETL, Lambda
- Primary Responsibilities - The role is to help migrate a number of old ETL jobs (Lambda, Glue, Snowlfake) into the customers new ETL standard (Airflow+Databricks). The consultants would be part of the broader customer team executing this project, but still be expected to be able to operate independently.
- Java/Spring Boot web app development experience. (Good to have)
- Microservices/RESTful API experience. (Good to have)
- AWS Certification/Cloud migration experience. (Good to have)