Job Openings #940 - Data Engineer

About the job #940 - Data Engineer

Job brief

Opportunity only available for Latam residents

Responsabilities

  • Designing and developing scalable, efficient, and reliable data pipelines to extract, transform, and load data from various sources to a target system. 
  • Responsible for ingesting data from various sources such as databases, files, APIs, or social media platforms using Python libraries like pandas, NumPy, and requests. 
  • Designing and implementing data storage solutions using relational databases like MySQL or PostgreSQL, NoSQL databases like MongoDB or Cassandra, or big data stores like Hadoop or Spark. 
  • Working closely with data scientists to understand their requirements and implement data pipelines that meet their needs. 
  • Ensuring the security of the data pipeline by implementing access controls, encryption, and authentication mechanisms. 
  • Working closely with DevOps teams to ensure smooth deployment of the data pipeline to production environments on Azure.

Requirements

  • B2 English Level or higher. 
  • +5 years of experience in a Data Engineering role.
  • +4 years of experience with Python. 
  • Experience with Big Data tools such as Hadoop, Spark, Kafka, among others, is expected. 
  • Proven experience with both relational SQL and NoSQL databases, such as PostgreSQL, Cassandra, or MongoDB. 
  • Experience with Azure cloud services is a must.
  • Good communication skills

What do we offer?

  • Type of contract: Independent Contractor with Venon Solutions LLC
  • Contract duration: Long-term
  • Benefits: 2 weeks of PTO (paid time off)
  • Holidays: from the North American calendar
  • Working hours: Full-time EST, fully committed (flexible hours).