Software Engineer —Automation Infrastructure (EU)

Software Engineer —Automation Infrastructure
About the role
Were looking for a Software Engineer to build and operate high-throughput, reliable data pipelines that ingest logs and sensor data at scale. Youll work end-to-end: from ingestion services and interfaces to cloud infrastructure, to testing/automation and data quality checks that keep datasets trustworthy and usable.
What youll do

• Design, build, and maintain high-volume log data pipelines (batch and/or streaming) with strong reliability and performance characteristics.
• Build pipeline components and services in Python, writing clean, maintainable, well-tested code.
• Interface pipeline systems with cloud infrastructure (compute, storage, networking, IAM), ensuring secure and scalable operation.
• Develop and maintain test automation frameworks for pipeline services and data processing jobs (unit, integration, end-to-end).
• Implement monitoring, alerting, and operational tooling to support pipeline health, throughput, latency, and cost visibility.
• Create and run data quality checks (schema validation, integrity checks, anomaly detection, completeness) with emphasis on video and other sensor data where applicable.
• Collaborate with platform, infrastructure, and product teams to define ingestion contracts, SLAs, and data interfaces.
• Debug production issues across services and systems; contribute to incident response and continuous improvement.

What we're looking for (required)

• Proficiency in Python and a track record of writing high-quality, production-grade code (readable, tested, well-documented, and maintainable).
• Strong software engineering fundamentals (design, debugging, performance, reliability).
• Experience building data pipelines or ingestion systems handling high event volume and/or large datasets.
• Proficiency with Linux (system tooling, networking basics, profiling, troubleshooting).
• Experience with cloud infrastructure (e.g., AWS/GCP/Azure concepts: storage, compute orchestration, IAM, networking).
• Experience building or contributing to test automation frameworks and CI-quality practices (repeatable, scalable, measurable tests).
• Comfortable working in distributed systems environments and owning services in production.