Docker
Senior Software Engineer, AI Gateway
$161K–$261K
San Francisco, CA or Seattle, WA · Remote · Senior · Full-time · Posted Oct 15, 2026
- Experience
- 6+ years of backend engineering experience with production-grade systems.
- Education
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Visa sponsorship
- Docker considers visa sponsorship on a case-by-case basis based on business needs.
About the job
Build and scale Docker’s AI Gateway, providing secure model and tool routing, developer APIs, observability, and infrastructure for agent and LLM workflows.
What you'll do
- Design and implement the model router, MCP gateway, and control plane, including routing, failover, and policy enforcement.
- Build secure gateway capabilities and infrastructure for evaluation, telemetry, replay, and backtesting.
- Lead technical and architectural decisions, mentor engineers, and contribute to roadmap planning.
What they ask for
- 6+ years of backend engineering experience with production-grade systems.
- Deep knowledge of distributed and highly scalable systems, cloud-native infrastructure, and API design.
- Experience building secure, high-throughput services; fluency in Go, and/or Rust.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Nice to have
- Prior experience with OpenAI, Anthropic, or similar LLM APIs.
- Familiarity with RAG, vector databases, agent frameworks, policy engines, observability frameworks, API gateways, OAuth2.1, cloud IAM, Kubernetes, Docker, or microservices.
Pay
$160,900 – $260,700 USD base salary
Tools
Go, Rust, OpenAI, Anthropic, LangChain, AutoGPT, CrewAI, Kubernetes
AI focus
Build infrastructure for AI agents and LLM workflows, including model and tool routing, MCP, evaluation, telemetry, replay, backtesting, and session summarization.
Model-written summary · the original posting is authoritative