Databricks
Staff Backend Software Engineer
$190K–$261K
New York · Staff · Full-time · Posted Mar 18, 2026
- Experience
- 8+ years of experience in backend or infrastructure engineering.
About the job
Build and operate the Unity AI Gateway control plane that routes AI requests, enforces budgets and guardrails, and supports reliable AI workloads.
What you'll do
- Build model-routing systems that balance quality, cost, latency, availability, and budget.
- Improve the reliability, latency, and efficiency of distributed AI workloads.
- Collaborate across research, platform, infrastructure, and AI/ML teams to deliver AI experiences.
What they ask for
- Strong programming skills in Scala or Go.
- Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure.
- Familiarity with service-oriented architecture, deployment pipelines, and system observability.
- Strong product and ownership mindset.
Nice to have
- Experience with real-time serving, AI infrastructure, or GPU orchestration.
- Exposure to Bedrock, Vertex AI, or Azure ML, or experience building developer platforms or internal tools for AI workflows.
Pay
$190,000 — $261,250 USD (salary range)
Tools
Scala, Go, Bedrock, Vertex AI, Azure ML
AI focus
Build AI request routing and gateway infrastructure, including budget enforcement and inline guardrails; improve distributed AI workloads.
Model-written summary · the original posting is authoritative