Anthropic
Staff + Sr. Software Engineer, Scaling
$320K–$485K
New York City, NY +5 · Staff · Full-time · Posted Sep 28, 2026
- Location
- New York City, NY
San Francisco, CA
Seattle, WA
New York, New York, United States
San Francisco, California, United States
Seattle, Washington, United States - Experience
- Years required correlate with internal job level requirements; no specific number stated.
- Education
- Bachelor’s degree or an equivalent combination of education, training, and/or experience; relevant field of study demonstrated through coursework, training, or professional experience.
- Visa sponsorship
- Visa sponsorship is available, but not for every role or candidate; if an offer is made, Anthropic will make every reasonable effort to obtain a visa and provides an immigration lawyer.
About the job
Build and scale the distributed inference systems that serve Claude, improve compute efficiency, and provide high-performance infrastructure for model research.
What you'll do
- Design and operate distributed inference systems, including intelligent routing, load balancing, and traffic management across accelerators and cloud providers.
- Optimize fleet efficiency and cost through autoscaling, orchestration, and production-grade model deployment pipelines.
- Integrate new accelerator platforms and model architectures, and provide inference infrastructure for researchers.
What they ask for
- Significant software engineering experience, particularly with distributed systems.
- Results-oriented approach, flexibility, and willingness to take on work beyond the job description.
- Desire to learn about machine learning systems and infrastructure.
- Care about the societal impacts of the work.
Nice to have
- Experience with high-performance, large-scale distributed systems or machine learning systems at scale.
- Experience with routing or traffic management; familiarity with LLM inference optimization, Kubernetes, cloud infrastructure, Python, or Rust.
Pay
$320,000 — $485,000 USD annual salary (base salary)
Tools
Kubernetes, AWS, GCP, Azure, Python, Rust
AI focus
Build inference infrastructure to serve Claude, optimize model inference, integrate accelerators and model architectures, and support researchers developing next-generation models.
Model-written summary · the original posting is authoritative