Anthropic
Staff + Senior Software Engineer, Inference Infrastructure
$320K–$485K
San Francisco, CA +5 · Staff · Full-time · Posted Jun 8, 2026
- Location
- San Francisco, CA
New York City, NY
Seattle, WA
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States - Experience
- Years of experience required will correlate with the internal job level requirements for the position; no specific number stated.
- Education
- Bachelor’s degree or an equivalent combination of education, training, and/or experience. Required field of study: a field relevant to the role as demonstrated through coursework, training, or professional experience.
- Visa sponsorship
- Visa sponsorship is available, but not for every role or candidate; if an offer is made, Anthropic will make every reasonable effort to obtain a visa and provides immigration lawyer support.
About the job
Build and operate large-scale, distributed inference infrastructure that serves Claude and enables efficient model research and deployment.
What you'll do
- Design, build, and maintain inference systems, including request routing, load balancing, traffic management, and fleet orchestration.
- Improve compute efficiency and reliability through autoscaling, deployment pipelines, and performance tuning.
- Integrate accelerator platforms and support inference for new model architectures.
What they ask for
- Significant software engineering experience, particularly with distributed systems.
- Results-oriented, flexible, and willing to take on work beyond the job description.
- Desire to learn about machine learning systems and infrastructure.
- Care about the societal impacts of your work.
Nice to have
- Experience with high-performance distributed systems, machine learning systems at scale, or routing and traffic management.
- Familiarity with LLM inference optimization, batching, and caching; Kubernetes and cloud infrastructure; or Python or Rust.
Pay
$320,000 — $485,000 USD (base salary)
Tools
Kubernetes, AWS, GCP, Azure, Python, Rust
AI focus
Provide high-performance inference infrastructure for Claude and researchers; optimize inference and support new model architectures and AI accelerators.
Model-written summary · the original posting is authoritative