Apple
Machine Learning Engineer, Human Centered AI - Evaluations & Insights
$142K–$263K
Seattle, Washington · Full-time · Posted Aug 25, 2026
- Experience
- 5+ years of relevant industry experience in ML Engineering or Applied Research.
- Education
- Bachelor’s or Master’s degree in Computer Science, Machine Learning, Artificial Intelligence, Cognitive Science, or a related technical field
About the job
Build and improve evaluation systems and MLOps infrastructure to assess and optimize AI models for reliable, safe, human-aligned Apple Media Services experiences.
What you'll do
- Design evaluation suites and scoring frameworks for LLMs and multimodal models, including safety, factuality, robustness, and human-perceived quality.
- Translate model failures and evaluation results into training signals, guardrails, and improvements to prompts, RAG strategies, and fine-tuning.
- Build scalable, automated evaluation and inference pipelines, including regression testing and human-centric assessments.
What they ask for
- 5+ years of relevant industry experience in ML Engineering or Applied Research.
- Advanced proficiency in Python and modern deep learning ecosystems, including PyTorch, JAX, and Hugging Face.
- Experience building scalable ML inference pipelines, model-evaluation workflows, and structured rating frameworks for large-scale AI systems.
- Hands-on experience developing, fine-tuning, or evaluating LLMs, multimodal models, and NLP systems.
Nice to have
- Knowledge of human factors, HCI, or cognitive science methodologies as applied to AI system design.
Pay
$142,300 and $263,300 USD base salary
Tools
Python, PyTorch, JAX, Hugging Face, Ray, vLLM, MLflow, Weights & Biases
AI focus
Evaluation and optimization of foundation models, generative AI, LLMs, and multimodal systems, including model alignment, safety, quality measurement, training signals, and human-centric assessment.
Model-written summary · the original posting is authoritative