42dot
Senior AI Data Pipeline Engineer (Autonomous Driving)
$133K–$254K
Sunnyvale, United States · Hybrid · Senior · Full-time · Posted Apr 29, 2026
- Experience
- Minimum of 7 years in Data Engineering, DataOps, or ML Platform roles.
- Education
- Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.
About the job
Builds scalable data pipelines, datasets, and serving tools that support autonomous-driving machine learning development and operations.
What you'll do
- Develop pipelines to turn fleet-collected raw data into scene datasets and automate labeling inferences.
- Build autonomous-driving data SDKs and a lakehouse for sensor, calibration, and annotation data.
- Improve pipeline performance and maintain data-platform infrastructure in collaboration with ML and cloud teams.
What they ask for
- Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.
- Proficient in Python, with solid Python SDK development experience.
- Hands-on experience orchestrating data pipelines with Databricks Workflows or Apache Airflow and integrating them with machine learning models.
- Experience with databases, data warehouse or lakehouse architectures, and Apache Spark or other big data computing engines.
Nice to have
- Experience with autonomous vehicle sensor data or the ML model training lifecycle.
- Understanding of modern AI frameworks, data governance, data privacy, or data security measures.
Pay
$133,000 - $254,000 (base salary); $133K – $254K (total pay)
Tools
Python, Databricks Workflows, Apache Airflow, MongoDB, PostgreSQL, Hive, Delta Lake, Apache Spark
AI focus
Enables autonomous-driving algorithms through data extraction, auto-labeling inference pipelines, and datasets and tools for ML training, evaluation, deployment, and monitoring.
Model-written summary · the original posting is authoritative