Cohere
Member of Technical Staff, Data Analysis and Evaluation
$250K–$535K
London +5 · Remote · Staff · Full-time · Posted Dec 15, 2025
- Location
- London
San Francisco
New York
Paris
Toronto
Montreal
About the job
Designs data collection and evaluation methods, assesses dataset quality, and trains and evaluates large language models to improve their reliability, robustness, and performance.
What you'll do
- Design and oversee data collection, support human annotators, and evaluate dataset quality using statistical methods.
- Analyze model generalisability and robustness, and conduct experiments to assess performance and identify improvements.
- Train and fine-tune large language models on distributed training infrastructures, collaborating with cross-functional teams.
What they ask for
- Strong software engineering, statistical, and experimental-evaluation skills.
- Experience designing data collection tasks with human annotators and assessing dataset quality, bias, and suitability for ML training.
- Hands-on experience training large language models on distributed training infrastructures; familiarity with evaluating ML robustness and generalisability.
- Proficiency in Python and ML frameworks such as PyTorch, TensorFlow, or JAX; one or more papers at a listed top-tier venue.
Pay
CA$250K – CA$535K (currency not stated; compensation type not stated)
Tools
Python, PyTorch, TensorFlow, JAX
AI focus
Trains and fine-tunes LLMs, evaluates their performance and dataset quality, and assesses model robustness and generalisability.
Model-written summary · the original posting is authoritative