Arena
Software Engineer - ML Infrastructure
$150K–$350K
SF Bay Area · On-site · Full-time · Posted Dec 18, 2025
- Experience
- 5+ years of software engineering experience, focused on ML infrastructure, distributed systems, or large-scale data platform engineering.
About the job
Designs and operates scalable infrastructure for AI model inference, reinforcement-learning post-training, distributed training, and model evaluation.
What you'll do
- Architect and optimize RL post-training infrastructure and low-latency model inference services.
- Build and maintain systems for distributed ML training, fine-tuning, and automated model evaluation.
- Improve availability, latency, and fault tolerance across GPU clusters and distributed event streams.
What they ask for
- Hands-on experience with PyTorch, model serving engines, and distributed training frameworks.
- Background in RL post-training infrastructure, RLHF, or automated model evaluation pipelines.
- Ability to design and operate low-latency, high-throughput, fault-tolerant distributed services at scale.
- Strong foundation in systems design, GPU cluster utilization, and performance tuning.
Pay
USD $150K – $350K; base salary or total pay not specified
Tools
PyTorch, GPU
AI focus
Builds infrastructure for AI model inference, reinforcement-learning post-training, distributed training, and evaluation.
Model-written summary · the original posting is authoritative