Senior Data Engineer

Jadeer is hiring on behalf of one of our clients in Cairo, Egypt.

A leading information and communications technology and business solutions provider. It is a market-leading solution integrator with a differentiated vertical approach to providing innovative​​ solutions in the various domains of the ICT sector.

Job Title: Senior Data Engineer

Scope: The key focus of the position is to build or maintain systems to capture and store data on behalf of the business.

Responsibilities:

• Design and Develop Data Infrastructure: Design, implement, and optimize data infrastructure, including data pipelines, ETL processes, and data storage solutions, to support large-scale data processing and analysis.
• Big Data Technologies: Utilize your expertise in big data technologies such as Apache Hadoop, Apache Spark, and related frameworks to architect and build scalable data processing and analytics solutions.
• Data Modeling and Schema Design: Work closely with data scientists and analysts to understand data requirements and design efficient data models and schemas for optimal data storage and retrieval.
• Data Integration and ETL: Develop and maintain robust data integration processes, ETL workflows, and data transformation pipelines using tools such as Apache NiFi to ensure the smooth and reliable flow of data from various sources to our data systems.
• Data Quality and Governance: Implement data quality checks, validation processes, and data governance practices to ensure data accuracy, consistency, and compliance with regulatory requirements.
• Performance Optimization: Identify and optimize performance bottlenecks in data processing, storage, and retrieval processes to achieve optimal performance and scalability.
• Troubleshooting and Issue Resolution: Collaborate with cross-functional teams to diagnose and resolve data-related issues, troubleshoot system failures, and ensure minimal downtime in data processing and availability.
• Collaboration and Mentoring: Collaborate with other data engineers, data scientists, and stakeholders to share best practices, provide technical guidance, and mentor junior team members.
• Emerging Technologies: Stay updated with the latest advancements in big data technologies, tools, and industry trends, and proactively identify opportunities to leverage new technologies, including Apache NiFi, for improved data engineering processes.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
• Minimum of 5 years of professional experience as a Data Engineer, with a focus on big data technologies.
• Strong expertise in big data technologies such as Apache Hadoop, Apache Spark, and related frameworks (e.g., Spark Streaming, Spark SQL).
• Proficiency in programming languages such as Python, Scala, or Java for data processing and manipulation.
• Experience with data modeling, schema design, and optimization techniques for structured and unstructured data.
• Solid understanding of ETL processes, data integration, and workflow management.
• Strong knowledge of SQL and experience working with relational databases like MySQL, PostgreSQL, or Oracle.
• Experience using Apache NiFi for data integration, routing, and transformation.
• Excellent problem-solving skills and the ability to analyze complex data-related issues.
• Strong communication and collaboration skills to work effectively in cross-functional teams.
• Experience with data visualization tools (e.g., Tableau, Power BI) is a plus.

Benefits:

• Collaborate with a talented and diverse team of professionals.
• Benefit from ongoing learning and development opportunities.
• Competitive compensation package and comprehensive benefits.
• Opportunity for career growth and advancement within the organization.
• Social & medical family Insurance.

Working Conditions:

• Working Hours: 9 AM - 5 PM (From Sunday to Thursday).
• Working Model: Hybrid (One or two days on-site).
• Job Type: Full-Time job.

At Jadeer, we value diversity and equal opportunity. We welcome applicants from all backgrounds and experiences.