Data Engineer, Data Quality & Provenance
Wayve- Location
- Leonberg, Germany
- Workplace
- Hybrid
- Employment
- Full Time
- Salary
- —
Posted yesterday
The role
As a Data Engineer focused on Data Quality & Provenance, you will build the data foundation that enables Wayve’s autonomous-driving development. You’ll turn vast volumes of fleet and simulation data into trusted, discoverable and reproducible datasets that ML, autonomy, simulation and safety teams can use with confidence. This is a high-impact opportunity to define the data products, standards and operating model behind embodied intelligence at petabyte scale.
Key responsibilities
- Design, build and operate scalable batch and streaming pipelines for multimodal fleet and simulation data.
- Create data models, catalogs, indexes and query capabilities that make sensor, vehicle-state, map and event data easy to discover and use.
- Build versioned, reproducible datasets for training, evaluation, replay, scenario mining and safety analysis.
- Develop robust workflows for data ingestion, synchronisation, transformation, curation, labelling and data-quality validation.
- Partner with autonomy, ML, simulation and safety engineers to define schemas, APIs and data contracts.
- Establish strong standards for lineage, observability, access controls, retention and cost management across the data platform.
- Improve the performance, reliability and unit economics of large-scale storage and compute workloads.
About you
In order to set you up for success as a Data Engineer, Data Quality & Provenance at Wayve, we’re looking for the following skills and experience.
Essential
- Strong hands-on Python and SQL skills, with solid production software-engineering fundamentals.
- Experience designing and operating large-scale distributed data systems, beyond small-scale analytics or reporting pipelines.
- Hands-on experience with distributed processing and workflow orchestration technologies, such as Spark, Flyte, Airflow or equivalent tools.
- Experience building and operating cloud-based data platforms using object storage, including data organisation, versioning, querying, governance and cost management.
- Proven ownership of data quality, lineage, observability, reproducibility and incident response for production data workflows.
- Experience translating ambiguous requirements from ML, data-science, robotics or similarly technical teams into durable, reusable platform capabilities.
- Comfort operating in ambiguity and helping define the boundaries, standards and ways of working for a growing data platform.
Desirable
- Experience in autonomous vehicles, ADAS, robotics, mapping, drones or another sensor-rich domain.
- Familiarity with time-synchronised sensor data, geospatial data, or multimodal datasets.
- Understanding of ML training, evaluation, simulation or closed-loop development workflows.
This is a full-time role based in our office in Leonburg, Germany. At Wayve we want the best of all worlds so we operate a hybrid working policy that combines time together in our offices and workshops to fuel innovation, culture, relationships and learning, and time spent working from home.
Skills
- Machine Learning
- Python
- SQL
- Spark
- Airflow
More jobs at Wayve
All 130Software Engineer, Embedded Automotive Platform
Wayve · Herzliya, Israel · today
Platform Engineer (SDO)
Wayve · Sunnyvale, California USA · today
Senior Software Engineer - Platform Integration, Robot Software
Wayve · Sunnyvale, California USA · USD 209,000–260,000/yr · yesterday
Data Scientist, Data Quality & Provenance
Wayve · Leonberg, Germany · yesterday
Staff Software Engineer - OS, Robot Software
Wayve · Sunnyvale, California USA · yesterday
Similar roles
Senior Data Scientist, Workforce Management Analytics
Wolt - English · Berlin, Germany · today
Senior Analytics Engineer, Consumer OR Merchant
Wolt - English · Berlin, Germany · Helsinki, Finland · Stockholm, Sweden · today
Data Scientist, Data Quality & Provenance
Wayve · Leonberg, Germany · yesterday
Senior Data Scientist (German-speaking)
Dataiku · Germany, · yesterday
Geospatial Data Scientist
Orcrist Technologies · Berlin · yesterday
Geospatial Data Engineer
Orcrist Technologies · Berlin · yesterday