About the job Lead Data Engineer
Helping to establish industry best practices for the data engineering team, by building the needed capabilities for the organization to become more data-driven.
Evolving our data architecture by determining structural requirements; developing and installing solutions.
Building upon existing data lakes & data warehouses based on structural requirements and in-depth analysis.
Testing and maintaining those databases to ensure their longevity and overall efficiency.
Hands-on 8+ years of experience in Data Engineering and Big Data.
Proven work experience with ETL Development or similar areas.
Advanced knowledge in Database Engines, Data Lakes, Data Practices, and policies.
In-depth understanding of database structure principles, integration, ETL, ELT, data processing, and data management.
Expertise in Data Warehouse & Data Lake technologies. Such as Vertica, Greenplum, Cloudera framework/ecosystems, Apache Kafka, ApacheNiFi, Apache Spark, Impala, etc).
Hands-on experience with programming languages, such as Python, Java, Scala, and SQL.
Experienced in assembling large, complex data sets that meet functional / non-functional business requirements.
Experienced in building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources technologies.
Bachelors degree in a related field.
Analytical skills and strong organizational abilities.