Zyphra
Research Engineer - Language Model Pre-Training
San Francisco · On-site · Full-time · Posted Mar 17, 2026
- Education
- Postgraduate degree in a scientific subject (Computer Science, EE/EECS, Math, Physics).
- Visa sponsorship
- Relocation and immigration support on a case-by-case basis.
About the job
Develop and optimize language-model pretraining, including large-scale training, data pipelines, and research experiments.
What you'll do
- Run large-scale training and model parallelization; optimize the pretraining stack.
- Collect, process, and evaluate datasets.
- Research model architectures and training methods, including optimizer ablations.
What they ask for
- Strong engineering aptitude for rapidly implementing reliable systems.
- Experience training on large-scale, multi-node GPU clusters.
- Deep understanding of model-training pipelines, including model/data parallelism and distributed optimizers.
- High proficiency with PyTorch and Python.
Nice to have
- Published machine learning research in well-respected venues.
- Postgraduate degree in a scientific subject (Computer Science, EE/EECS, Math, Physics).
Tools
PyTorch, Python
AI focus
Language-model pretraining, training optimization, dataset evaluation, and architecture and methodology research.
Model-written summary · the original posting is authoritative