Job Responsibilities

We are looking for creative thinkers and problem-solvers to design new and innovative solutions using the latest technologies available.

Your primary responsibilities would include understanding the business requirements and providing structured data using distributed computing in the cloud to address those requirements.

In collaboration with the rest of the team, you would be responsible for building and maintaining high-quality data pipelines that would service the needs of people around the world!

Job Description:

• Designs and builds end‑to‑end data pipelines (ingestion transformation storage);
• Build connections between different data sets;
• Implement calculations to enrich the information provided (transformation) over existing data sets;
• Ensures data reliability, accuracy, and timeliness;
• Structures raw data into analytics ready datasets;
• Monitors data pipelines and prevents/diagnoses data issues;
• Build and maintain a REST API application with a focus on performance and resource management;
• Work with new data sources from around the world to provide data to our Global Data Analytics Platform built on Azure Cloud;
• Design, construct, and maintain Data Warehouse models to support PSA regional data analytics needs;
• Create and maintain data pipelines to transform and load data from data lake into Data Warehouse models;
• Work and collaborate closely with PSA data analytics team;
• Degree from a recognized university, preferably in Data Analytics or Computer Science domain.

Requirements

Required Technical Skills:

• 5+ years of experience building web applications and REST API using Python and its most famous frameworks (Django, Flask, FastAPI);
• Experience with OOP and ORM;
• Experience with data frames, data ingestion from files, etc. using Python and its most famous libraries (NumPy, Pandas, PySpark, etc.);
• Experience with developing applications and data pipelines following the most common security standards;
• Ability to assess performance of models and introduce optimizations;
• Experience in data processing with Python is a must;
• Good knowledge of SQL is a must;
• Good understanding and/or experience with big data.

Advantages:

• Knowledge of cloud computing/distributed computing;
• Experience with writing data applications in Kubernetes;
• Experience with Cloud Data storage services (Azure Queue Storage/Azure Blob Storage);
• Hands-on experience in Azure Data Factory, Azure Synapse Analytics / Data Warehouse, Azure Analysis Services; Azure Databricks;
• Hands-on experience as a Data Engineer, especially using Microsoft data tools.

Personal Skills:

• Analytical, meticulous, team player;
• Strong written and oral communication skills in English;
• Strong interpersonal skills to liaise effectively with users and stakeholders; overcoming challenges of language, cultural, and time zones;
• Ability to work under pressure towards fixed deadlines, on multiple projects;
• Ability to work independently in a dynamic environment;
• Open communication attitude;
• Work experience in a multinational environment is a plus.