Apple
Sr. Machine Learning Engineer, Speech LLM Evaluation
$166K–$325K
Cambridge, Massachusetts +1 · Senior · Full-time · Posted Oct 2, 2026
- Location
- Cambridge, Massachusetts
Cupertino, California - Education
- Bachelor's degree in Computer Science, Electrical Engineering, or a related field, or equivalent practical experience.
About the job
Evaluates audio LLMs by building real-world datasets, defining metrics, and developing automated assessment tools in collaboration with modeling and partner teams.
What you'll do
- Design and curate audio evaluation datasets; define metrics and automated evaluation tools for audio LLMs.
- Analyze evaluation results to identify gaps and regressions, and communicate findings to modeling teams.
- Partner with human-evaluation, infrastructure, and product teams to validate and integrate evaluation methods.
What they ask for
- Experience building or working with text, speech, or audio evaluation pipelines and metrics.
- Proficiency in Python and experience building data processing pipelines at scale.
- Experience curating or annotating datasets for machine learning evaluation or training.
- Working knowledge of statistics and familiarity with automated and human LLM evaluation methods.
Nice to have
- Experience evaluating audio-native or multimodal (speech-in, speech-out) large language models.
- Experience designing or running human evaluation studies at scale.
Pay
USD 184,700–324,800 base salary; USD 165,800–292,400 base salary
Tools
Python, Spark
AI focus
Evaluates speech and audio LLMs, including dataset and metric design, automated evaluation pipelines, and LLM-as-judge tooling.
Model-written summary · the original posting is authoritative