Senior Data Engineer

Brief Description

We are seeking a highly skilled Senior Data Engineer to join our team . This is an exciting

opportunity to build and develop Banking big data use cases using most recent big data

technologies, enabling data-driven decision-making across the Digital channels in Banking

Industry. You will play a key role in designing and implementing robust, scalable, and secure data

use cases to ensure delivering high-quality data that powers our analytics, machine learning, and

development efforts.

Tasks

Documenting data use cases requirements

Designing, implementing, and maintaining a best -in-class data platform (centered on

Cloudera and Denodo) to support current and future business needs.

Creating efficient and scalable ETL/ELT Spark, PySpark, Airflow, Informatica BDM pipelines to

ingest, process, and store data from various sources.

Defining and implementing data models Hive / Denodo optimized for analytics and

machine learning.

Planning and executing the scaling of the data pipelines

Implementing processes for data monitoring, error handling, and system performance

optimization.

Collaborating with Product, Engineering, and Product Analytics teams to improve data

models, increase data accessibility, and support A/B tests.

Documenting data models, source to target mapping, pipeline designs, and operational

procedures while communicating effectively with both technical and non-technical

stakeholders.

Qualifications and Requirements

7+ years of experience in data engineering, with a proven track record in building large-scale

data systems.

Experience and has Banking Industry Knowledge

Strong expertise in Cloudera services, PySpark, Spark, Informatica Big data Management