Drimva

Duolingo

Proctor Quality and Learning Manager, Scaling Operations

$91K–$123K

London, England +2 · Manager · Full-time · Posted Sep 30, 2026

Location
London, England
New York, New York, United States
Pittsburgh, Pennsylvania, United States
Experience
5+ years in one of the stated relevant fields; no alternatives stated.

About the job

Owns the quality standards, calibration, adjudication, and ongoing learning system for Duolingo English Test proctors, including validation of AI-assisted workflows.

What you'll do

  • Define and maintain proctoring standards, rubrics, decision rules, and auditable guidance; lead calibration and adjudication.
  • Build training, onboarding, and certification programs; use quality data to assess effectiveness and direct interventions.
  • Guide Training Specialists and adjudicators, and partner across teams to evolve quality controls and validate AI-assisted capabilities.

What they ask for

  • 5+ years in assessment development, scoring/rater quality, certification, quality assurance, or another field involving complex, consequential judgments; experience aligning reviewers through calibration programs.
  • Adult-learning program experience covering onboarding, certification, ongoing training, remediation, and effectiveness measurement.
  • Experience designing quality standards and rubrics, with auditable decision logs, change histories, and controls.
  • Experience defining benchmarks and validation methods for human–technology workflows, including AI-assisted processes.

Nice to have

  • Experience in language assessment, test security, remote proctoring, trust and safety, or fraud prevention.
  • Experience maintaining quality across large, distributed populations; familiarity with assessment concepts or learning, audit, and analytics tools.

Pay

£90,630–£122,617 GBP base salary

AI focus

Establish benchmarks and validate AI-assisted proctoring capabilities against real sessions before deployment; ensure human and AI-assisted workflows meet accuracy standards.

Model-written summary · the original posting is authoritative

First seen Oct 10, 2026 · Last verified Nov 5, 2026 (UTC)