Data engineer

Backend / Data Engineer — Pipeline & Data Architecture

We are engaging a Senior Data Engineer to design and build the data pipelines underpinning an AI-enabled delivery programme for one of our clients - a global leading strategy-led Tech consultancy for their technology build unit.

You will work within Palantir Foundry, building production-grade pipelines that directly support downstream AI applications.

What you'll be doing

• Designing and building robust data pipelines using Foundry Transforms (Python / SQL)
• Modelling data within Foundry's ontology layer (objects, relationships, properties)
• Integrating data from external systems (APIs, batch ingestion, files)
• Ensuring data quality, reliability, and lineage visibility
• Structuring datasets for downstream application and AI consumption
• Collaborating closely with AI engineers to align data outputs with usage needs

What we're looking for

Must have

• Strong experience designing and owning production data pipelines
• Solid Python and/or SQL for data processing
• Experience working with modern data platforms (e.g. Foundry, Databricks, Spark, dbt)
• Good understanding of:
  • data modelling
  • pipeline reliability
  • data quality and governance

Strongly preferred

• Hands-on experience with Palantir Foundry:
  • Transforms
  • dataset management
  • ontology modelling

Nice to have

• Experience supporting AI / LLM use cases
• Familiarity with how data is consumed in LLM workflows
• Experience with real-time or near-real-time pipelines

If you are experienced in designing data that works reliably in production and is usable downstream — not just pipelines that run, we want to hear from you.