Cohere
Member of Technical Staff, Pre-Training Data
$250K–$535K
Toronto +5 · Remote · Staff · Full-time · Posted Jun 25, 2025
- Location
- Toronto
San Francisco
London
New York
Paris
Montreal
About the job
Develops and evaluates pre-training data pipelines, curation methods, and data mixtures to improve language model performance and training efficiency.
What you'll do
- Conduct data ablations and experiment with data mixtures to assess quality and improve model performance.
- Develop data modeling and curation methods to structure datasets for efficient training.
- Collaborate with researchers and engineers on data pipelines for language models.
What they ask for
- Strong software engineering skills, proficiency in Python, and experience building data pipelines.
- Familiarity with curriculum learning, data mixing, and data attribution.
- Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
- Experience with large-scale datasets, including web data, code data, and multilingual corpora.
Nice to have
- Paper at a top-tier venue, such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, or EMNLP.
Pay
CA$250K – CA$535K (total pay)
Tools
Python, Apache Spark, Apache Beam, Pandas
AI focus
Pre-training data research and engineering for language models, including data quality assessment, data mixing, and curation to improve model performance and training efficiency.
Model-written summary · the original posting is authoritative