Job Openings Azure Data Engineer

About the job Azure Data Engineer

The consultants will work as Azure Data Engineer as stated below.

  • End to end development lifecycle, including the following environments Development, QA, Preproduction and Cutover activities
  • End to end data flow development including: SAP and Non-SAP Extraction, Ingestion, Data Landing, Data Vault, Data Mart and reporting layer backend.
  • End to end data flow development including: Extraction, Ingestion, Bronze, Silver, Gold, Data Mart and reporting layer backend for Lakehouse development.
  • Technical design and architecture
  • Code review, performance tuning and code optimization
  • Assist/Develop Data Models
  • Development, unit test and document results
  • Technical solutions and quality check
  • Data validation and verification
  • Support SIT, Regression and performance testing
  • Assist UAT testing
  • Provide technical documentation that can be used for KT session to the Support team

Required Qualifications:

  • Bachelor degree required
  • Strong experience working with Azure Platform & Azure BI Stack (Azure data factory / SQL / Azure Synapse /Azure SSAS /Azure DevOps /Azure Pipelines /Azure Data Lake). At least 3 years experience working with Azure Platform & Azure BI Stack
  • Deep understanding relational database systems, modern Datawarehouse platforms like Azure SQL Synapse.
  • Experience building and automating data system components that enable - Data acquisition, cleansing, and persistence data engineering.
  • Proficient in writing complex SQL queries.
  • Solid understanding of key Business Intelligence and Analytics trends.
  • Experience with Visualization tools like Power BI is a Plus.
  • Understanding of how to define and support a data governance framework.
  • Experience with implementing companywide Business Intelligence and Analytics programs.
  • Understanding of agile software development methodologies.

Personal characteristics:

  • Communications skills
  • High level of English to mainten conversation with leaders and team members.
  • Leadership and proactive actitud
  • Innovative and creative personality.
  • Smart thinker
  • Previous experiences working in corporate companies with different work groups and authorization levels

Essential Functions

  • Design and develop data warehouses and data pipelines within Azure
  • Design and develop Azure ML model execution pipelines
  • Evangelize engineering design and development standards
  • Act as a key contributor to the design and development lifecycle of analytic applications.
  • Participate in Agile ceremonies including daily stand-ups, sprint planning, retrospectives, and product demonstrations
  • Produce efficient and elegant code that meets business requirements
  • Author unit tests that adhere to code coverage guidelines
  • Proactively communicate progress, issues, and risks to stakeholders
  • Accurately estimate assignments
  • Create and maintain technical documentation
  • Mentor less experienced engineers
  • Contribute to the growth and maturity of the Software Engineering Group
  • Performs other related duties as directed

Required Skills & Competencies

  • 7 years of hands-on experience designing and implementing large-scale distributed data architecture for BI and OLTP systems
  • 7 years of hands-on experience designing and implementing large-scale data pipelines
  • 4 years of hands-on experience in Azure data services
  • 4 years of hands-on experience with data integration using ETL / ELT tools
  • Experience doing data migrations from SAP into Azure Datalakes using Theobald.
  • 4 years of hands-on experience with Python including object-oriented programming and unit testing
  • Advanced experience with one or more Python parallel processing libraries
  • Advanced experience with one or more Python data analysis libraries
  • Advanced data modeling experience
  • Broad experience in Microsoft SQL technologies
  • Broad multi-tenant data architecture and implementation experience across different data stores, messaging systems and data processing engines
  • Experience with data integration through APIs, Web Services, SOAP, and/or REST services
  • Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
  • Knowledge of SOA and Micros Services Application Architecture
  • Ability to work in a fast-paced, collaborative team environment
  • Excellent written and verbal communication skills and ability to express ideas clearly and concisely.
  • Previous experience in Supply Chain related projects.

Desired Attributes

  • Strong team player with ability to collaborate with all levels of the organization
  • Possess a drive towards forward progress and delivering results while taking responsibility
  • Multi-tasker with ability to set and manage priorities
  • Proactively and transparently communicate challenges and successes to product leadership
  • Exhibit attention to detail
  • Flexibility and willingness to help in other areas as priorities shift
  • Ability to effectively operate with minimal supervision, but knowing how to keep leadership in the loop

Education or Prior Work Experience

  • Bachelor's degree in CS or related field, master's degree preferred
  • 7+ years of experience with designing and developing complex data architecture solutions
  • 4+ years of design and development experience with Microsoft Azure data architecture and related solutions
  • 4 years of hands-on experience with Python

Or refer someone