Syffer is an all-inclusive consulting company focused on talent, tech and innovation. We exist to elevate companies and humans all around the world, making change, from the inside to the outside.

We believe that technology + human kindness positively impacts every community around the world. Our approach is simple, we see a world without borders, and believe in equal opportunities. We are guided by our core principles of spreading positivity, good energy and promote equality and care for others.

Our hiring process is unique! People are selected by their value, education, talent and personality. We dont present ethnicity, religion, national origin, age, gender, sexual orientation or identity.

Its time to burst the bubble, and we will do it together!

What You'll do:

- Design and implement a common Python library for Databricks used across batch and streaming data pipelines;

- Develop reusable PySpark modules and abstract classes for Bronze, Silver, and Gold processing layers;

- Collaborate with other engineers to ensure coding standards, documentation, and testing practices are followed;

- Maintain CI/CD integration with GitLab and Databricks Asset Bundles (DABs);

- Work closely with DataOps to ensure library updates are stable and observable in production;

- Integrate monitoring and logging standards using Grafana and DQX for data quality validation;

- Work within Databricks, Airflow on AKS, and Terraform-managed infrastructure;

- Ensure smooth library deployment, versioning, and package management across environments;

- Collaborate with DataOps to enforce secure and performant runtime environments;

- Utilize stack components including Talend, Azure ADLS Gen2, Azure Databricks, Airflow (AKS), Terraform, SQL, Python, PySpark, Grafana, Kafka (Aiven), GitLab, Databricks Asset Bundles (DABs), and DQX (Data Quality Framework);

- Hybrid Work Model;

What You Are:

- Proven experience with Databricks, PySpark, and Python library design;

- Strong software engineering background OOP, testing, CI/CD, and abstraction principles;

- Understanding of both batch and streaming data processing;

- Knowledge of Medallion Architecture and data lifecycle best practices;

- Familiarity with Airflow (AKS), Terraform, and Azure ADLS Gen2;

- Fluent in Portuguese and English;



What youll get:

- Wage according to candidate's professional experience;

- Remote Work whenever possible;

- Allocation of health insurance from the beginning of the employment;

- Delivery of work equipment adjusted to the performance of functions;

- And others.

Work together with expert teams on projects of large magnitude and intensity, long term together with our clients, all leaders in their industries.

Are you ready to step into a diverse and inclusive world with us?

Together we will promote uniquess!