Anyscale
Software Engineer, ML Developer Experience
$226K–$283K
San Francisco · Hybrid · Full-time · Posted Aug 26, 2026
- Experience
- 5+ years of experience writing high-quality production code
- Education
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
About the job
Build and operate developer-facing tools, interfaces, and backend services that help users and coding agents develop, run, monitor, debug, and productionize machine-learning workloads on Anyscale and Ray.
What you'll do
- Build developer tooling, CLI, SDK, API, MCP, and MLOps capabilities for AI workloads.
- Improve workflows for distributed execution, observability, debugging, model deployment, and the AI development lifecycle.
- Work with users and field teams to design, ship, and operate scalable, highly available platform services.
What they ask for
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
- 5+ years of experience writing high-quality production code
- Solid background in algorithms, data structures, and system design
- Experience with modern machine-learning tooling and hands-on experience building and operating highly available production services
Nice to have
- Experience building and maintaining open-source projects
- Experience building and operating machine-learning infrastructure or highly available serving systems, or using Ray
Pay
$226K – $283K (base salary)
Tools
Ray, PyTorch, MLflow, CLI, SDK, API, MCP, OpenTelemetry
AI focus
Build tools and platform capabilities for the AI workload lifecycle, including data preparation, fine-tuning and post-training, evaluation, serving, and iteration; support coding agents in developing and operating AI workloads.
Model-written summary · the original posting is authoritative