Waymo
Senior Machine Learning Engineer, Runtime and Serving
$213K–$263K
Mountain View, CA, USA +1 · Senior · Full-time · Posted Apr 29, 2026
- Location
- Mountain View, CA, USA
Mountain View, California, United States - Experience
- 5+ years of ML systems and infrastructure software engineering; 5+ years of production C++; 3+ years of production Python and major deep learning frameworks.
- Education
- B.S. or M.S. in CS, EE, Deep Learning, or a related field.
About the job
Develop high-performance ML inference runtime and serving systems for autonomous vehicles and large-scale data centers.
What you'll do
- Architect and build ML runtime and serving systems that meet onboard latency and memory constraints and offboard throughput needs.
- Integrate inference runtimes and migrate ML workloads toward a JAX-native architecture, including extending ML compilers and runtimes.
- Optimize system-level ML workloads and build tools to profile, benchmark, and identify bottlenecks.
What they ask for
- B.S. or M.S. in CS, EE, Deep Learning, or a related field.
- 5+ years of professional software engineering experience focused on ML systems and infrastructure.
- 5+ years of production programming in C++.
- 3+ years of production experience in Python and major deep learning frameworks; experience optimizing ML software for hardware accelerators and building low-latency, highly concurrent distributed backend systems.
Nice to have
- PhD in CS, EE, Deep Learning, or a related field.
- Experience modifying ML compilers, runtimes, or inference engines; LLM serving; custom kernel development; or unified serving APIs and tensor buffer management.
Pay
$213,000 — $263,000 USD base salary
Tools
JAX, XLA, Triton, CUDA, OpenXLA/PjRT, TensorRT, Python, C++
AI focus
Build and optimize ML inference and serving systems for onboard autonomous driving and offboard data center workloads, including JAX-native runtime migration.
Model-written summary · the original posting is authoritative