Apple
AIML - Manager, Applied AI Science - LLM/VLM-as-judge
$206K–$356K
Cupertino, California · Manager · Full-time · Posted Oct 6, 2026
- Experience
- 1+ years building LLM/VLM-based evaluators, autograders, or automated evaluation systems; 5+ years in machine learning, model alignment, or benchmark creation; experience managing teams of 3+ engineers and/or scientists.
- Education
- MS/PhD degree in Computer Science, Machine Learning, AI, or a related field.
About the job
Lead a team building scalable LLM/VLM-based systems that automatically evaluate the quality of Apple’s AI products.
What you'll do
- Hire, develop, and manage applied AI scientists and machine learning engineers.
- Set the technical vision and roadmap for autograders, evaluation methods, and tools; deliver reliable evaluation systems.
- Partner across organizations to standardize and automate evaluation workflows and resolve dependencies.
What they ask for
- 1+ years of industry experience building LLM/VLM-based evaluators, autograders, or automated evaluation systems.
- 5+ years of hands-on experience in machine learning, model alignment, or benchmark creation.
- Track record of managing teams of 3+ machine learning engineers and/or AI scientists.
- Deep understanding of GenAI evaluation methodologies, including rubric design, evaluation set development, validation, calibration, and human-model alignment.
Nice to have
- Experience translating emerging GenAI techniques and research into production-ready systems.
- Experience scaling AI/ML solutions into reusable platforms, frameworks, or standardized workflows.
Pay
$206,200 and $356,400 (base salary range)
Tools
LLM, VLM, GenAI, AI/ML
AI focus
Develop and lead LLM/VLM-based autograding systems for automated quality assessment of internal GenAI products.
Model-written summary · the original posting is authoritative