Crusoe
Senior Production Engineer, Managed AI
$170K–$205K
San Francisco, CA - US +2 · On-site · Senior · Full-time · Posted Oct 29, 2026
- Location
- San Francisco, CA - US
Sunnyvale, CA - US
Bellevue, WA - US
About the job
Designs and operates reliable, scalable managed AI services and infrastructure for latency-sensitive LLM workloads.
What you'll do
- Build automation, reliability tooling, and observability for distributed AI pipelines and inference services.
- Define and improve SLIs/SLOs, performance, and reliability across AI workloads.
- Investigate reliability issues and collaborate on optimizing large-scale training and inference clusters.
What they ask for
- Production-grade software engineering experience beyond scripting or Bash.
- Demonstrated experience designing and implementing distributed systems.
- Hands-on experience with LLMs or AI/ML infrastructure.
- Proficiency in at least one of Python, Go, Java, or C++; familiarity with Kubernetes or container orchestration platforms.
Nice to have
- Experience scaling LLM inference or training workloads.
Pay
$170,000 - $205,000 (total pay)
Tools
Python, Go, Java, C++, Kubernetes, Bash
AI focus
Build and operate managed AI services for LLM workloads, including distributed inference pipelines and large-scale training and inference clusters.
Model-written summary · the original posting is authoritative