Data Cloud Platform Architect

About Welvaart

On a daily basis, we assume commitments and present solutions to our stakeholders in order to create a structure of human values, based on professionalism, honesty and rigor.

With a management based on Human Centered Design, we take care of our professionals with consistent career plans, but flexible with their needs and expectations of evolution. Our management team guarantees an empathetic and present leadership that will provide superior technological engagement and delivery to our clients' projects and products.

Project

We are looking for a highly experienced Lead Data Engineer to lead strategic data initiatives in cloud environments, with a focus on AWS and integration with Azure. This role will be responsible for defining data engineering standards, leading large-scale migration and optimization projects, and ensuring technical excellence in scalable and secure data solutions.

Role

• Design scalable and efficient data solutions on AWS, aligned with cloud architecture best practices.
• Integrate Azure data services when necessary, promoting interoperability between platforms.
• Develop and maintain Terraform templates to automate the deployment of data platforms.
• Lead large-scale data migration and optimization initiatives, ensuring performance and reliability.
• Coordinate technical teams and stakeholders to deliver robust solutions.
• Create PoCs and production prototypes to validate technical approaches.
• Define and apply coding standards in Python and SQL.
• Work with Iceberg tables and other technologies to manage massive datasets efficiently.
• Implement data pipelines with Apache Airflow and AWS Step Functions.
• Integrate ETL tools and streaming technologies such as Kafka.
• Define and apply data security and governance policies in accordance with internal and regulatory standards.
• Establish and optimize CI/CD pipelines for data workloads, promoting automation and continuous quality.
• Use Azure Databricks for engineering and data analysis tasks, when applicable.
• Fluency in Portuguese and English (C1 level or higher).

We are looking for

• Bachelors or Masters degree in Computer Science, Engineering, or equivalent professional experience.
• Over 10 years of experience in AWS data services, with exposure to Azure data services.
• Experience in developing Infrastructure as Code templates (e.g., Terraform) for platform deployment.
• Proven experience leading large-scale data migration and optimization projects.
• Strong programming skills in Python and SQL, with experience in prototyping and defining coding standards.
• Experience with Iceberg tables and efficient management of large datasets.
• Proficiency in designing scalable and efficient data solutions on AWS, following best practices for cloud architecture and infrastructure.
• Experience with orchestration tools such as Apache Airflow and AWS Step Functions.
• Knowledge of ETL tools and experience working with large volumes of data, with preference for experience with Kafka.
• Proven ability to define and enforce data governance and security standards.
• Define data engineering standards by creating Proofs of Concept (PoCs) and production-grade prototypes.
• Responsible for establishing and optimizing CI/CD pipelines for data workloads.
• Familiarity with Azure Databricks for data engineering and analytics tasks will be considered an advantage.
• Fluency in Portuguese and English (C1 level or higher).

What you can discover with us?

• Be part of a tech start-up
• Different scopes of project in different sectors
• Structure of fairness and equity salary (Consultant Profile)
• Training & Certification
• Career Path management
• More than 30 Partnerships
• Welvaart Ambassador Program

UNLEASH THE POWER OF YOUR CAREER