Institute of Foundation Models
Data & Eval Operations Program Manager
$250K–$450K
Sunnyvale, CA · On-site · Manager · Full-time · Posted Oct 5, 2026
- Experience
- 5+ years of relevant industry experience, including at least 3 years in program management with technical teams.
- Education
- Bachelor's degree in computer science, engineering, business, or economics; MBA or advanced technical degree is a plus.
- Visa sponsorship
- Eligible for visa sponsorship.
About the job
Build and manage end-to-end data acquisition and evaluation operations programs for foundation models, coordinating internal technical teams and external vendors.
What you'll do
- Establish and own data operations and evaluation programs, including processes, goals, and ongoing management.
- Manage data vendors, budgets, performance, contracts, and cross-functional coordination with Legal and Procurement.
- Develop and improve evaluation workflows, connect evaluation results to data strategy, and track relevant benchmarks.
What they ask for
- Bachelor's degree in computer science, engineering, business, or economics.
- 5+ years of relevant industry experience, including at least 3 years in program management with technical teams and direct work with researchers and engineers.
- Experience managing multi-million-dollar budgets.
- Vendor management across multiple vendors, including contracts and SOWs; autonomous program ownership covering budget, timeline, and quality.
Nice to have
- Experience with LLMs, Generative AI, or ML Infrastructure, and data vendors for LLM development.
- Familiarity with key LLM/agentic benchmarks and how they evolve.
Pay
$250,000 – $450,000/year (base salary)
Tools
LLMs, Generative AI, ML Infrastructure
AI focus
Operations for foundation model data acquisition and evaluations, using evaluation results to inform data strategy.
Model-written summary · the original posting is authoritative