Apple
AIML - Sr Manager, Evaluation - Data Science & Insights
$226K–$382K
Seattle, Washington · Manager · Full-time · Posted Aug 19, 2026
- Experience
- 6+ years in data science and machine learning evaluation, including 3+ years leading technical teams.
- Education
- Advanced degree in a quantitative field such as Statistics, Computer Science, Machine Learning, or similar.
About the job
Leads a data science team responsible for evaluation methods that improve the quality of Apple Intelligence, Siri AI, and other consumer-facing features.
What you'll do
- Own the evaluation roadmap and translate strategy into methods and deliverables.
- Lead, recruit, develop, and retain data scientists; drive hands-on human evaluation and LLM-based autograders and rubrics.
- Partner with product and engineering teams to incorporate evaluation into development and deliver measurable quality improvements; represent the work to senior leaders.
What they ask for
- Strong experience in human evaluation methodology for consumer-facing products at scale.
- Hands-on experience building and deploying LLM-based autograders and rubrics to improve models and agentic features.
- Track record leading teams of 7+ data scientists and/or machine learning engineers; strong written and verbal communication skills.
Nice to have
- Experience evaluating large consumer AI products and familiarity with evaluation frameworks for agentic systems and tool-use.
- Experience with logging infrastructure and instrumentation for AI product quality measurement; track record growing senior contributors or recruiting talent.
Pay
$225,600 and $381,600 USD base salary
Tools
LLM-based autograders, rubrics
AI focus
Leads evaluation for AI products, building and deploying LLM-based autograders and rubrics and using evaluation to improve models and agentic features.
Model-written summary · the original posting is authoritative