Duolingo
Proctor Quality and Learning Manager, Scaling Operations
$91K–$123K
London, England +2 · Manager · Full-time · Posted Sep 30, 2026
- Location
- London, England
New York, New York, United States
Pittsburgh, Pennsylvania, United States - Experience
- 5+ years in one of the stated relevant fields; no alternatives stated.
About the job
Owns the quality standards, calibration, adjudication, and ongoing learning system for Duolingo English Test proctors, including validation of AI-assisted workflows.
What you'll do
- Define and maintain proctoring standards, rubrics, decision rules, and auditable guidance; lead calibration and adjudication.
- Build training, onboarding, and certification programs; use quality data to assess effectiveness and direct interventions.
- Guide Training Specialists and adjudicators, and partner across teams to evolve quality controls and validate AI-assisted capabilities.
What they ask for
- 5+ years in assessment development, scoring/rater quality, certification, quality assurance, or another field involving complex, consequential judgments; experience aligning reviewers through calibration programs.
- Adult-learning program experience covering onboarding, certification, ongoing training, remediation, and effectiveness measurement.
- Experience designing quality standards and rubrics, with auditable decision logs, change histories, and controls.
- Experience defining benchmarks and validation methods for human–technology workflows, including AI-assisted processes.
Nice to have
- Experience in language assessment, test security, remote proctoring, trust and safety, or fraud prevention.
- Experience maintaining quality across large, distributed populations; familiarity with assessment concepts or learning, audit, and analytics tools.
Pay
£90,630–£122,617 GBP base salary
AI focus
Establish benchmarks and validate AI-assisted proctoring capabilities against real sessions before deployment; ensure human and AI-assisted workflows meet accuracy standards.
Model-written summary · the original posting is authoritative