AI Research Scientist - MSL FAIR Foundations

What you'll do

• Curate benchmarks and build evaluation environments and datasets for frontier models.
• Develop reusable evaluation pipelines and tooling to assess the quality and reliability of evaluation suites.
• Implement research scientists’ technical vision for new benchmarks and evaluations.

What they ask for

• Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience, and a PhD in Computer Science, Machine Learning, or a related technical field.
• 3+ years of experience in machine learning engineering, machine learning research, or a related technical role.
• Proficiency in Python and experience with ML frameworks such as PyTorch.
• Experience independently delivering medium-to-large technical features and proven software engineering practices, including version control, testing, and code review.

Nice to have

• Peer-reviewed publications related to language model evaluation, benchmarking, or deep learning.
• Experience with language model post-training, deep learning systems, reinforcement learning environments, evaluation benchmarks for large language or multimodal models, distributed systems and data pipelines, evaluation frameworks and metrics, or open-source ML evaluation tools or benchmarks.

Pay

$184,000/year to $257,000/year (base salary)

Tools

Python, PyTorch

AI focus

Measures and evaluates frontier AI capabilities through benchmarks, evaluation environments, datasets, and scalable pipelines, informing model research and development.