Anthropic
Engineering Manager, Inference Infrastructure
$405K–$625K
San Francisco, CA +3 · Manager · Full-time · Posted Sep 1, 2026
- Location
- San Francisco, CA
New York City, NY
Seattle, WA
San Francisco, California, United States - Experience
- Years required correlate with the internal job level; 5+ years of engineering management experience preferred.
- Education
- Bachelor’s degree or an equivalent combination of education, training, and/or experience; relevant field of study demonstrated through coursework, training, or professional experience.
- Visa sponsorship
- Visa sponsorship is available, but not for every role or candidate; the company says it will make every reasonable effort to obtain a visa for candidates it offers.
About the job
Leads the team responsible for coordinating Anthropic’s inference fleet and request path to improve performance, reliability, and efficiency.
What you'll do
- Set the technical roadmap for traffic routing, capacity placement, caches, and control-plane protocols.
- Partner with adjacent teams to deliver measurable throughput, latency, utilization, and cost improvements.
- Lead team development and operations, including hiring, on-call, incident response, postmortems, and deploy safety.
What they ask for
- Engineering management experience leading teams responsible for critical-path production infrastructure at scale.
- Deep systems expertise in areas such as load balancing, scheduling, cluster orchestration, autoscaling, distributed state, or high-performance networking.
- Experience delivering and quantifying performance or efficiency improvements in large-scale systems, including cost impact.
- Experience operating production infrastructure, including on-call, incident response, capacity events, and deploy discipline.
Nice to have
- 5+ years of engineering management experience.
- Experience with LLM inference serving, large-scale fleet control, multiple clouds, heterogeneous accelerators, or infrastructure at supercomputing or hyperscaler scale.
Pay
$405,000 — $625,000 USD annual salary (base salary)
Tools
Kubernetes
AI focus
Leads infrastructure for serving model inference, including request routing, fleet capacity, and coordination with inference engines.
Model-written summary · the original posting is authoritative