Job Openings Senior Data Engineer

About the job Senior Data Engineer

About the role:

We are seeking a highly skilled and motivated Senior Data Engineer to join our team to help define and build Pharmanovias long-term data management strategy. Pharmanovia is aiming to build a highly autonomous self-service data and analytics platform, which can extract and align data from many best-in-class SaaS platforms (e.g. SAP S4 HANA, Salesforce CRM, Veeva RIMS and others) to deliver efficient business insights to Pharmanovia management and operational teams.

As a Senior Data Engineer, you will play a crucial role in defining Pharmanovias long-term data analytics strategy, covering but not limited to:

Data Architecture Infrastructure (AWS):

Design and implement scalable data architectures to support various data sources and types

Select appropriate database technologies data warehouses and/or data lakes

Manage cloud infrastructure to support data processing and storage need

Data Integration ETL:

Develop pipelines to ingest, clean, and integrate data from disparate sources

Automate data integration processes to improve efficiency and reliability

Implementing reporting and visualization tools for data exploration and analysis

Identify and implement optimizations to enhance data processing and query performance

Data Analytics:

Building analytical capabilities to support self-service data analytical tools

Reporting and maintenance of data quality of core datasets and define improvement strategies

Develop data infrastructure to support potential AI/ML use-cases

Data Governance:

Establishing data governance frameworks, policies, and standards

Defining data ownership, stewardship, and quality management processes

Implementing data management practices for data acquisition, storage, integration, and archival

Data Security:

Ensuring compliance with relevant data privacy regulations (e.g., GDPR, CCPA, HIPAA)

Conducting regular audits and assessments to assess and mitigate data security risks

In addition to the above, you will need to demonstrate a good understanding of the real-life use cases for the data to ensure activities are appropriately prioritised and any data issues or concerns that could impact decision making are identified and well communicated. You will be required to collaborate with various technical and non-technical teams across Pharmanovia to understand business problems and deliver solutions appropriate to the business requirements.

You should have extensive experience working with the AWS platform as well as additional tools, such as Databricks, and have demonstrated proficiency in designing and managing databases and data platforms.

As a Senior Data Engineer, you will play a crucial role in building and optimising our data infrastructure, ensuring scalability, reliability, and efficiency. This role is essential for driving data-driven decision-making and enhancing our ability to extract insights from vast amounts of data.

Main responsibilities duties:

  • Collaborate with cross-functional teams to understand business requirements and translate them into scalable, secure, and reliable AWS solutions
  • Support the definition of Pharmanovias long-term data management strategy
  • Define and implement key tools to enact Pharmanovias data management strategy
  • Design and development of data pipelines using AWS services such as Lambda, EC2, S3, RDS, DynamoDB, etc. from a variety of sources (SaaS platforms, excel, email attachments, sFTPs etc)
  • Optimise system performance, reliability, and cost-efficiency through continuous monitoring, troubleshooting, and optimization of AWS resources
  • Ensure compliance with industry standards and regulations (e.g., HIPAA, GDPR) for data security and privacy in AWS environments
  • Implement best practices for infrastructure as code (IaC) using tools like AWS CloudFormation or Terraform to automate provisioning and deployment processes.
  • Stay updated on emerging AWS technologies and trends and evaluate their potential to enhance Pharmanovias cloud infrastructure.
  • Provide technical guidance and mentorship to junior team members, fostering a culture of learning and innovation within the engineering team

About you:

  • Bachelors or Masters degree in Computer Science, Engineering, or related field
  • ITIL Foundation desirable
  • Knowledge of ITIL 4 and change management practices
  • Proven experience designing, developing, and deploying cloud-based solutions on AWS
  • In-depth knowledge of AWS services and their use cases, with a focus on compute, storage, networking, security, and monitoring
  • Proficiency in programming languages such as Python, Java, or Node.js, and experience with serverless computing (AWS Lambda)
  • Hands-on experience with containerization technologies (e.g., Docker, Kubernetes) and familiarity with container orchestration on AWS (Amazon EKS)
  • Strong understanding of DevOps principles and experience with CI/CD pipelines using tools like AWS Code Pipeline, Jenkins, or GitLab CI/CD
  • Excellent problem-solving skills and ability to troubleshoot complex issues in distributed systems
  • Effective communication skills with the ability to collaborate effectively with cross-functional teams
  • Service-oriented with excellent customer service persona
  • Great analytical skills, methodical and high attention to detail
  • Creative solution-oriented mindset, and the ability to take own initiative
  • Approachable, helpful, and flexible attitude
  • Strong verbal and written English language skills
  • Ability to travel internationally if required
  • Driving licence.

Please use the below link for job application and quicker response.

https://lifelancer.com/jobs/view/1e43b34aeeefa044190fed75f4f0f036


Or refer someone