About the job Data Catalog Engineer
We are looking for a Data Catalog Engineer with hands-on experience in implementing and managing Databricks Unity Catalog. The ideal candidate will be skilled in configuring catalog objects, automating governance policies, and integrating metadata with data pipelines. This role plays a key part in ensuring data discoverability, governance, lineage, and compliance across the organization.
Key Responsibilities
-
Unity Catalog Implementation: Configure and manage Unity Catalog objects including metastores, catalogs, schemas, tables, views, and volumes in Databricks.
-
Access & Security: Develop and automate RBAC/ABAC policies, data masking, and access controls for secure data usage.
-
Data Asset Onboarding: Onboard and register data assets from multiple sources with consistent metadata standards.
-
Lineage & Integration: Build and maintain data lineage pipelines and ensure catalog integration with ETL/ELT processes.
-
Governance Tools: Collaborate on metadata and governance initiatives using tools like Microsoft Purview or equivalent.
-
Compliance: Support data privacy and compliance requirements including HIPAA, GDPR, and CCPA.
Key Skills & Experience
-
4+ years of experience in data engineering, data governance, or metadata management.
-
Hands-on expertise with Databricks Unity Catalog.
-
Strong knowledge of RBAC/ABAC, access controls, and data masking techniques.
-
Experience integrating data catalogs with ETL/ELT pipelines.
-
Familiarity with data governance frameworks and tools such as Microsoft Purview.
-
Understanding of data privacy regulations (HIPAA, GDPR, CCPA).
-
Solid skills in SQL, Python, or PySpark for data engineering and automation.
Why Join Us?
-
Opportunity to work at the forefront of data governance and catalog engineering.
-
Gain hands-on expertise with Databricks Unity Catalog and modern governance tools.
-
Play a critical role in building a trusted enterprise data ecosystem.
-
Competitive salary and career growth opportunities.