Apple
AIML - Sr Software Engineer - AI, Evaluation
$150K–$278K
Cupertino, California · Senior · Full-time · Posted Oct 1, 2026
- Experience
- 8+ years of software engineering experience.
- Education
- BS/MS/PhD in Computer Science, Machine Learning, or a related field.
About the job
Own and advance Apple’s AI evaluation platform, building systems that assess the quality of Apple Intelligence, Siri, and generative features and inform product launch decisions.
What you'll do
- Own a core evaluation system end-to-end, including architecture, roadmap, reliability, and developer experience.
- Design testing and validation strategies, and integrate annotation, compute, reporting, and benchmarking platforms.
- Partner with LLM-judge teams to productize recurring needs and promote high-quality use of AI coding agents.
What they ask for
- BS/MS/PhD in Computer Science, Machine Learning, or a related field.
- 8+ years of software engineering experience, including ownership of production systems used by other teams.
- Exceptional Python skills and strong knowledge of system design, API design, testing and validation, debugging, and monitoring.
- Experience shipping production code with AI coding agents while maintaining quality.
Nice to have
- Proficiency in agentic systems, LLM-based applications, LLM-as-judge systems, and offline evaluations.
- Experience interpreting evaluation results and building technical integrations across platforms in a large organization.
Pay
$150,400 to $277,600 USD base salary
Tools
Python, LLM-as-judge
AI focus
Build and operate evaluation systems for AI products, including LLM-as-judge autograders and validation against human judgment; use AI coding agents while maintaining software quality.
Model-written summary · the original posting is authoritative