Senior Applied Scientist, Frontier AI Assets - Assessments (FAI)

What you'll do

• Design assessment methodology, measurement methods, and automated systems, including agent-based audits.
• Oversee expert audits, review findings, mentor scientists, and communicate results to data and model teams and senior leaders.
• Set technical direction and publish research on assessment methodology; contribute to patents.

What they ask for

• 5+ years of experience building machine learning models for business applications.
• Programming experience in Java, C++, Python, or a related language; experience with neural deep learning and machine learning.
• PhD in Computer Science, Engineering, Mathematics, Statistics, Economics, or a related field.
• Experience with machine learning and LLM fundamentals or delivering complex software systems to customers; plus experience in a listed technical area or designing/architecting systems.

Nice to have

• Knowledge of public benchmarks for frontier AI models and agents and their limitations; experience with large-scale human data collection or model post-training and alignment pipelines.
• Experience developing recursive self-improving agents; top-tier ML publications; or academic research or teaching experience.

Pay

167,100.00 - 226,100.00 USD annually (base salary)

Tools

Java, C++, Python, Large Language Model, LLM-as-a-Judge

AI focus

Build and calibrate automated assessment systems, progressing from LLM-as-a-Judge to self-improving agents that plan audits, critique judgments, and improve accuracy over time.