Sr Engineering Program Manager, Apple Intelligence Evaluations

What you'll do

• Own evaluation plans, including scope, metrics, timelines, and launch-readiness criteria.
• Coordinate complex workstreams and partner with product, research, data science, engineering, privacy, and legal teams.
• Manage annotation and data collection, and communicate evaluation results and program status to executive leadership.

What they ask for

• Bachelor's or Master's degree in EE, CS, CE, or equivalent.
• 5+ years of experience managing large-scale, ML-powered and software programs across large organizations.
• Demonstrated program management, analytical, and cross-functional leadership skills, including data-driven decision-making and process improvements.
• Excellent written and verbal communication and strong problem-solving skills with attention to detail.

Nice to have

• Direct program management experience with Generative AI or Large Language Models (LLMs); familiarity with LLM evaluation practices.
• Experience analyzing product data or shipping AI features in a consumer product; understanding of how ML systems are built, evaluated, and released.

Pay

$144,600 and $263,800 USD base salary

Tools

ML, Generative AI, Large Language Models (LLMs)

AI focus

Plans and coordinates evaluation of foundation models and AI features, including evaluation metrics, methodologies, data, and launch readiness.