Senior DataOps Engineer

Jadeer is hiring on behalf of one of our clients in Cairo, Egypt.

A leading information and communications technology and business solutions provider. It is a market-leading solution integrator with a differentiated vertical approach to providing innovative​​ solutions in the various domains of the ICT sector.

Job Title: Senior DataOps Engineer

Scope: The key focus of the position is to develop and maintain data pipelines, automate data integration processes, and optimize data workflows to ensure efficient and reliable data operations within an organization.

Responsibilities:

• Data Operations Infrastructure: Design, implement, and maintain the data operations infrastructure, including data pipelines, workflows, and automation frameworks, to ensure the smooth and secure flow of data across systems.
• Data Pipeline Development and Automation: Develop, test, and deploy data pipelines using tools such as Apache Airflow, Luigi, or similar frameworks. Implement automation techniques to streamline data processes and reduce manual intervention.
• Data Monitoring and Alerting: Establish monitoring systems and implement proactive alerting mechanisms to detect and resolve data-related issues, ensuring high data quality and system availability.
• Performance Optimization: Identify and optimize performance bottlenecks in data operations processes, including data ingestion, transformation, and storage, to achieve optimal system performance and scalability.
• Data Security and Compliance: Ensure data security and compliance with relevant regulations (e.g., GDPR, CCPA) by implementing appropriate data access controls, encryption mechanisms, and data governance practices.
• Collaboration and Communication: Collaborate closely with cross-functional teams, including data engineers, data scientists, and IT operations, to understand their data requirements, provide technical guidance, and drive effective data operations practices.
• DevOps Integration: Implement DevOps practices and methodologies within the data operations domain, including version control, continuous integration, and deployment strategies, to ensure efficient and agile data operations processes.
• Incident Response and Troubleshooting: Participate in incident response and troubleshooting activities to identify and resolve data-related issues, minimize system downtime, and ensure data integrity.
• Data Documentation and Knowledge Sharing: Document data operations processes, workflows, and configurations. Share knowledge and best practices with the team to foster continuous learning and improvement.
• Emerging Technologies: Stay updated with the latest trends and advancements in data operations, DevOps, and cloud technologies. Proactively identify opportunities to leverage new tools and techniques to enhance data operations processes.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Minimum of 5 years of professional experience as a DataOps Engineer, Data Engineer, or similar role.
• Strong expertise in data operations, including data pipeline development, workflow automation, and data monitoring.
• Proficiency in data pipeline orchestration tools such as Apache Airflow, Apache NiFi, or Luigi.
• Experience with containerization technologies and orchestration frameworks (e.g., Docker, Kubernetes) is desirable.
• Strong knowledge of scripting languages (e.g., Python, Bash).
• Familiarity with data governance principles, data security, and compliance regulations.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Strong problem-solving skills and the ability to analyze complex data operations issues.
• Excellent communication and collaboration skills to work effectively in cross-functional teams.
• Knowledge of data warehousing concepts and dimensional data modeling is a plus.

Benefits:

• Collaborate with a talented and diverse team of professionals.
• Benefit from ongoing learning and development opportunities.
• Competitive compensation package and comprehensive benefits.
• Opportunity for career growth and advancement within the organization.
• Social & medical family Insurance.

Working Conditions:

• Working Hours: 9 AM - 5 PM (From Sunday to Thursday).
• Working Model: Hybrid (One or two days on-site).
• Job Type: Full-Time job.

At Jadeer, we value diversity and equal opportunity. We welcome applicants from all backgrounds and experiences.