Apple
Staff Machine Learning Platform Engineer, AI Evaluation
$205K–$308K
Seattle, Washington · Staff · Full-time · Posted Apr 21, 2026
- Experience
- 8+ years of software engineering experience.
About the job
Leads the architecture and development of Apple’s self-service AI evaluation platform, turning research methods into scalable services and tools for generative AI and agent systems.
What you'll do
- Design and build platform APIs, SDKs, and orchestration services; set technical direction and evaluation strategy.
- Partner with research engineers to productionize evaluation methods and determine software and infrastructure needs.
- Own developer experience and operational standards, including testing, CI/CD, monitoring, and reliability.
What they ask for
- 8+ years of software engineering experience, including ownership of platform-level technical direction.
- Experience building AI/agent evaluation systems beyond traces, addressing multi-step reasoning, judge model reliability, and scoring drift.
- Python as the primary language; strength with FastAPI, Pydantic, and job orchestration frameworks (Temporal.io or similar).
- Production ownership of CI/CD, containerization, and monitoring; ability to assess research code and infrastructure needs.
Nice to have
- Experience with distributed compute frameworks (Ray, Dask).
- Startup or early-stage experience; familiarity with LLM token economics, rate limiting, and cost management at scale.
Pay
$205,400 and $308,500 (base salary)
Tools
Python, FastAPI, Pydantic, Temporal.io, Go, Rust, Ray, Dask
AI focus
Builds evaluation infrastructure for generative AI and agent systems, including multi-turn agent trajectories, tool-use chains, and model failure analysis.
Model-written summary · the original posting is authoritative