Fireworks AI
Member of Technical Staff, LLM Infrastructure
$175K–$220K
San Mateo +2 · Hybrid · Staff · Full-time · Posted Nov 5, 2025
- Location
- San Mateo
Greater Seattle Area
New York - Experience
- 3 years required; 5+ years preferred.
- Education
- Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
About the job
Build and maintain infrastructure that supports Fireworks AI’s generative AI platform, including distributed training, inference, model serving, and reliability and performance improvements.
What you'll do
- Develop scalable backend infrastructure and services, including the LLM CI/CD pipeline, control plane, and model serving systems.
- Improve performance, cost efficiency, reliability, and model quality across compute, storage, and networking.
- Collaborate with performance, training, and product teams to turn research and product needs into infrastructure solutions.
What they ask for
- Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
- 3 years of software engineering experience focused on infrastructure or machine learning systems.
- Strong programming skills in Python, Go, or a similar language.
- Experience with ML infrastructure and tooling, and basic understanding of LLM concepts.
Nice to have
- 5+ years of software engineering experience focused on infrastructure or machine learning systems.
- Experience with open-source inference engines such as vLLM, Sglang, or TRT-LLM; open-source contributions and large-scale ML/MLOps infrastructure experience are also preferred.
Pay
USD $175K – $220K base salary
Tools
Python, Go, PyTorch, MLflow, Vertex AI, SageMaker, Kubernetes, vLLM
AI focus
Build infrastructure for distributed training, inference, model serving, and model quality safeguards for generative AI.
Model-written summary · the original posting is authoritative