Docker
Staff Software Engineer, AI Gateway
$170K–$276K
San Francisco, CA or Seattle, WA · Remote · Staff · Full-time · Posted Oct 15, 2026
- Experience
- 8+ years of backend engineering experience.
- Education
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Visa sponsorship
- Visa sponsorship is considered on a case-by-case basis based on business needs.
About the job
Sets technical direction and builds secure, scalable infrastructure for Docker’s AI Gateway, including model and tool routing, policy enforcement, observability, and agent evaluation.
What you'll do
- Architect and deliver core gateway systems, including model routing, MCP gateway, and control plane.
- Solve complex infrastructure problems involving model selection, failover, cost-based routing, credentials, and policy enforcement.
- Build agent and LLM evaluation and analytics infrastructure, mentor engineers, and shape product direction.
What they ask for
- 8+ years of backend engineering experience owning production-grade systems at significant scale.
- Deep expertise in distributed systems, cloud-native infrastructure, and API design; experience building secure, high-throughput services.
- Fluency in Go and/or Rust; track record of driving systemic improvements across team boundaries.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Nice to have
- Prior experience with OpenAI, Anthropic, or similar LLM APIs; familiarity with RAG, vector databases, or agent frameworks.
- Experience with policy engines, observability frameworks, API gateways, OAuth 2.1, secret management, cloud IAM, Kubernetes, Docker, or microservices.
Pay
$170,350 – $275,550 USD base salary
Tools
Go, Rust, OpenAI, Anthropic, Google, AWS Bedrock, MCP, LangChain
AI focus
Builds AI Gateway infrastructure for agent applications, including model and tool routing, LLM and agent evaluation, analytics, observability, and policy enforcement.
Model-written summary · the original posting is authoritative