Drimva

Apple

AIML - Machine Learning Engineer, Evaluation - Responsible AI and Safety

$185K–$325K

Cupertino, California · Full-time · Posted Oct 30, 2026

Experience
At least 4 years of relevant work experience with an MS or PhD, or 8+ years with a BA/BS; 2+ years directly managing engineering teams.
Education
MS or PhD in Computer Science, Linguistics, Cognitive Science, HCI, Psychology, Mathematics, Physics, or a similar science or technology field with a strong basis in scientific data collection and analysis; or BA/BS.

About the job

Leads a team evaluating and improving the safety and fairness of generative AI products through metrics, datasets, human and automated assessment, and scalable evaluation pipelines.

What you'll do

  • Set technical direction and lead, mentor, and develop an engineering team focused on responsible AI evaluation.
  • Develop safety and fairness metrics, datasets, sampling strategies, and human-in-the-loop and automated evaluation methods.
  • Oversee end-to-end evaluation pipelines, investigate failures, and communicate findings and safety recommendations to product teams and leadership.

What they ask for

  • MS or PhD in a listed or similar science or technology field with a strong basis in scientific data collection and analysis plus at least 4 years of relevant work experience, or BA/BS with 8+ years of relevant work experience; 2+ years directly managing engineering teams.
  • Experience analyzing varied language, image, voice, video, and/or multimodal data, including human- and LLM-generated data.
  • Experience with LLM-Judges and human-in-the-loop techniques, including designing annotation projects and guidelines for nuanced, conflicting data.
  • Proficiency in data science, machine learning, analytics, Python & Pandas, and AI-assisted coding tools; experience with plotting and visualization libraries.

Nice to have

  • Experience in Responsible AI, multimodal models, agentic systems, diverse languages/locales, or large-scale benchmarking.
  • Scientific research and publication experience, or experience with AI compliance and regulation.

Pay

$184,700 and $324,800 USD base salary

Tools

LLM-Judges, Python, Pandas

AI focus

Responsible AI evaluation of generative AI, including safety and fairness assessment for large language, image-generation, and multimodal systems.

Model-written summary · the original posting is authoritative

First seen Oct 31, 2026 · Last verified Nov 5, 2026 (UTC)