Fireworks AI
Member of Technical Staff, AI Training Infrastructure
$210K–$320K
San Mateo +3 · Hybrid · Staff · Full-time · Posted Jul 31, 2026
- Location
- San Mateo
Greater Seattle Area
New York
San Francisco - Experience
- 3+ years of experience with distributed systems and ML infrastructure.
- Education
- Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.
About the job
Design, build, and optimize infrastructure and distributed pipelines for large-scale LLM and multimodal model training.
What you'll do
- Build scalable training infrastructure and distributed training pipelines.
- Optimize training performance, reliability, efficiency, and cost across GPUs, nodes, and data centers.
- Develop monitoring and debugging tools, and maintain training data storage and infrastructure orchestration.
What they ask for
- Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.
- 3+ years of experience with distributed systems and ML infrastructure.
- Experience with PyTorch and proficiency in cloud platforms (AWS, GCP, Azure).
- Experience with containerization and orchestration (Kubernetes, Docker), and knowledge of distributed training techniques (data parallelism, model parallelism, FSDP).
Nice to have
- Master's or PhD in Computer Science or related field.
- Experience training large language models or multimodal AI systems.
Pay
$210K – $320K (base salary)
Tools
PyTorch, AWS, GCP, Azure, Kubernetes, Docker, FSDP
AI focus
Develop and optimize infrastructure for large-scale LLM and multimodal model training.
Model-written summary · the original posting is authoritative