Databricks
Senior Software Engineer, AI Runtime
$160K–$225K
Mountain View, California +2 · Senior · Full-time · Posted Jun 8, 2026
- Location
- Mountain View, California
San Francisco, California
Mountain View, California - Experience
- 5+ years in large-scale distributed systems, with experience in GPU training, high-performance computing, or ML systems.
- Education
- BS in Computer Science or a related field (MS or PhD preferred).
About the job
Build and evolve Databricks’ AI Runtime, the infrastructure for reliable, efficient large-scale model training on GPUs.
What you'll do
- Build core AI Runtime systems, including reliability, observability, orchestration, GPU scheduling, data loading, and checkpointing.
- Improve training performance, cost efficiency, and developer experience across GPU generations and workload types.
- Own features from design through production, collaborating with research, product, and customers.
What they ask for
- 5+ years in large-scale distributed systems, with experience in GPU training, high-performance computing, or ML systems.
- Experience training large models with FSDP, DeepSpeed, or Megatron, and familiarity with parallelism strategies.
- Working knowledge of GPU performance, accelerator architecture, high-speed interconnects, and kernels.
- Strong understanding of training resilience patterns, such as checkpointing, failure detection, and automatic recovery.
Nice to have
- Background building and running multi-tenant cloud platforms as products.
- BS in Computer Science or a related field; MS or PhD preferred.
Pay
$160,000 — $225,000 USD base salary
Tools
FSDP, DeepSpeed, Megatron
AI focus
Develop AI training infrastructure for large-scale model training; improve training reliability, efficiency, GPU support, and developer experience for people and AI agents.
Model-written summary · the original posting is authoritative