Databricks
Staff Software Engineer- Foundation Model Inference
$190K–$265K
San Francisco, California +1 · Staff · Full-time · Posted Jul 24, 2026
- Location
- San Francisco, California
Mountain View, California - Experience
- 8+ years
About the job
Build and improve enterprise-scale infrastructure for serving and optimizing foundation models and other large-scale inference workloads.
What you'll do
- Build LLM infrastructure for partner and self-hosted models.
- Improve reliability, latency, and efficiency of distributed AI workloads.
- Collaborate with platform, infrastructure, and ML teams on end-to-end experiences.
What they ask for
- Experience in backend or infrastructure engineering.
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
- Experience with real-time serving, ML infrastructure, or GPU orchestration.
- Familiarity with service-oriented architecture, deployment pipelines, and system observability.
Nice to have
- Exposure to SageMaker, Vertex AI, or Azure ML.
- Contributions to MLflow, PyTorch, Ray, vLLM, or SGLang; or experience building developer platforms or internal tools for AI workflows.
Pay
$190,000 — $265,000 USD (base salary)
Tools
OpenAI, Anthropic, Gemini, Qwen, GPT-OSS, Llama, SageMaker, Vertex AI
AI focus
Build and operate inference infrastructure for foundation models, enabling enterprise customers to serve, scale, and optimize LLMs.
Model-written summary · the original posting is authoritative