Research Engineer, Live Experiment Analysis
Mountain View, CA, USA · Full-time · Posted Oct 13, 2026
- Education
- Bachelor's degree in Computer Science, Electrical Engineering, Mathematics, Statistics, a related technical field, or equivalent practical experience.
About the job
Evaluates model launches and improves end-to-end model evaluations using data, user feedback, and production verification.
What you'll do
- Evaluate and model launch analyses; provide continuous production evaluation and verification for model releases.
- Work cross-functionally on data collection, management, quality measurement, and improvements.
- Analyze user feedback and deliver insights to improve frontier models and user experiences.
What they ask for
- Bachelor's degree in Computer Science, Electrical Engineering, Mathematics, Statistics, a related technical field, or equivalent practical experience.
- Experience with machine learning and software engineering.
- Experience in Python programming.
- Experience in data analysis and related tools and processes.
Nice to have
- Master’s degree or PhD in Engineering, Computer Science, a technical related field, or equivalent practical experience.
- Experience with evaluations and user feedback analysis; large-scale data analysis, autorater development, or human-in-the-loop quality improvements.
Pay
$207000 - $300000 (USD) base salary
Tools
Python, Colab, Gemini
AI focus
Evaluates and improves frontier models, including launch analysis, user-feedback analysis, production evaluation and verification, and model quality improvements.
Model-written summary · the original posting is authoritative