xAI
Software Engineer, Evaluation Infrastructure
$180K–$440K
Palo Alto, CA · Full-time · Posted Sep 30, 2026
About the job
Develops scalable evaluation infrastructure for AI models, partnering with modeling and evaluation teams to maintain evaluation quality and support model training.
What you'll do
- Build reliable, efficient, easy-to-use infrastructure to run evaluations at scale.
- Collaborate on new evaluations, evaluation signal quality, and internal tooling for model training.
- Find and resolve performance bottlenecks across inference, capacity fleet management, and asynchronous evaluation orchestration.
What they ask for
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++.
Nice to have
- Experience building, debugging, and optimizing large-scale distributed systems.
- Experience with LLM inference, GPU compute management, workload scheduling, dynamic resource optimization, or interfaces for comparing models and evaluations.
Pay
$180,000 - $440,000 USD (base salary)
Tools
Python, PyTorch, JAX, Rust, C++
AI focus
Build infrastructure for evaluating and training next-generation AI models.
Model-written summary · the original posting is authoritative