Data Engineer Sr (Python/SQL/Azure/Airflow/Retail)

Data Engineer

As a Data Engineer, you will be responsible for supporting our customer engagements by designing, developing and deploying scalable data-driven solutions in a high-performance, customer-driven environment.

AI-based platform enables autonomous decision-making that creates a connected assortment strategy, category and pricing execution and trade promotion environment. The team comes from leading CPGs and brings their experiences to build a fully customizable AI-based platform that gives CPGs and Consumer Brands the most explain-ability, foresight, and granularity that results in an unprecedented quality of decision-making.

If you are passionate about leveraging the power of AI to help clients reach their full potential, this is the opportunity for you!

Responsibilities

Lead the development of highly available, fault-tolerant, and scalable data management.

Systems that support various AI models and analytics applications.

Build and maintain data integration, ETL pipelines, and data warehouse architectures on.

Cloud platforms like AWS, Azure, and GCP.

Create re-usable documentation for easy knowledge transfer across teams.

Work with cross-functional teams comprising Data Scientists, Product Managers, and Software Engineers to design, build, and deploy robust and scalable data pipelines that power real-time decision-making.

Suggest areas of improvement for other data engineers, and help drive innovation and best practices.

Work closely with the customer success team to troubleshoot and resolve issues related to data quality, ingestion, and integration.

Assist in selecting technologies and tools that enhance performance, scalability, and security of data infrastructure.

Requirements

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.

Minimum 2 years in the CPG/Retail space or minimum 5 years of experience in designing, building, and deploying large-scale data management systems - ideally in cloud and/or SaaS environments.

Strong proficiency in programming languages such as Python, Java, and/or Scala.

Deep understanding of big data technologies and platforms.

Experience with cloud computing platforms such as AWS, Azure, and/or GCP.

Experience with data warehousing and ETL technologies such as Databrickes, Redshift, Snowflake, and Airflow.

Exposure to B2B solutions in either CPG, Retail, Supply Chain or other analogs optimization and/or AI-enabled industries.

A strong focus on quality, testing and validation to ensure downstream users and processes can rely on your results.

Intellectual curiosity to understand how our customers will use our solutions and how the data aspects of the engagement play a pivotal role in delivering value to our customers.

Excellent communication skills and ability to work collaboratively in a cross-functional team environment.