Institute of Foundation Models
Eval360 - Error Analysis Engineer
$150K–$450K
Sunnyvale, CA · On-site · Full-time · Posted Jun 19, 2026
- Experience
- No specific number of years stated.
- Education
- Bachelor's degree in Computer Science, Machine Learning, Data Science, Software Engineering, Statistics, or a related technical field required; Master's or Ph.D. in a related field preferred.
- Visa sponsorship
- Eligible for visa sponsorship.
About the job
Build and operate Eval360, an AI model evaluation service and quality gate, with a focus on analyzing model failures and improving evaluation workflows and tools.
What you'll do
- Analyze model outputs to identify failure patterns, trace root causes, and improve evaluation methods.
- Build evaluation review interfaces, dashboards, APIs, back-end services, and data pipelines.
- Develop error taxonomies, evaluation rubrics, quality thresholds, and regression detection methods.
What they ask for
- Bachelor's degree in a related technical field.
- Proven experience in software engineering, full-stack development, machine learning evaluation, data science, AI engineering, or a similar role.
- Experience building software systems for AI, machine learning, data analysis, evaluation, annotation, experimentation, or model monitoring.
- Experience with error analysis, model evaluation, data quality analysis, or failure-mode investigation for machine learning or language model systems.
Nice to have
- Master's or Ph.D. in a related field.
- Experience with large language models, foundation models, multimodal models, or model evaluation systems.
Pay
USD 150,000–450,000 per year (base salary)
Tools
HTML, CSS, JavaScript, TypeScript, React, Angular, Python, FastAPI
AI focus
Evaluate AI models, investigate and categorize their failures, and improve model quality measurement and release readiness.
Model-written summary · the original posting is authoritative