Inception Labs
Member of Technical Staff, Training Infra
San Mateo, United States · On-site · Staff · Full-time · Posted Mar 10, 2026
- Education
- BS/MS/PhD in Computer Science, Engineering, or a related field (or equivalent experience).
About the job
Design, optimize, and maintain infrastructure that makes large language model training scalable, efficient, reliable, and reproducible.
What you'll do
- Build distributed training systems that scale across thousands of GPUs and nodes.
- Optimize system performance to improve training throughput and efficiency.
- Create reusable frameworks and libraries for reliable, reproducible training of new model architectures.
What they ask for
- BS/MS/PhD in Computer Science, Engineering, or a related field, or equivalent experience.
- Understanding of PyTorch or TensorFlow from a systems perspective, with strong engineering and debugging skills.
- Proficiency in Python and at least one of C++, Rust, or Go.
- Experience with Docker, Kubernetes, and CI/CD pipelines.
Nice to have
- Experience building and maintaining language models with tens of billions of parameters or more.
- Experience with Kubeflow or Airflow, ML systems profiling, or distributed frameworks such as PyTorch/XLA, DeepSpeed, and Megatron-LM.
Tools
PyTorch, TensorFlow, Python, C++, Rust, Go, Docker, Kubernetes
AI focus
Build and improve infrastructure for scalable training of large language models.
Model-written summary · the original posting is authoritative