Staff Engineering Analyst, Trust and Safety RAI Testing, Scaled Testing
Kirkland, WA, USA · Staff · Full-time · Posted Oct 22, 2026
- Experience
- 7 years in data analysis and 7 years managing projects; preferred: 7 years of experience or familiarity with machine learning systems and/or specified programming languages.
- Education
- Bachelor's degree or equivalent practical experience; preferred: Master's degree in a quantitative discipline.
About the job
Leads Google-wide GenAI safety evaluation strategy and infrastructure, translating high-risk assessments into scalable testing, monitoring, and governance systems.
What you'll do
- Define the Trust and Safety RAI SCALE roadmap, metrics, and automated governance.
- Design production evaluation pipelines and unified testing and monitoring data systems; lead cross-organizational gap analyses and scale LLM-as-a-judge autoraters.
- Make decisions on critical GenAI safety escalations, align executive stakeholders, and mentor Engineering Analysts.
What they ask for
- Bachelor's degree or equivalent practical experience.
- 7 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
- 7 years of experience managing projects and defining project scope, goals, and deliverables.
Nice to have
- Master's degree in a quantitative discipline.
- 7 years of experience or familiarity with machine learning systems and/or SQL, R, Python, or C++.
Pay
$188000 - $274000 USD base salary
Tools
SQL, R, Python, C++, LLM-as-a-judge
AI focus
Leads scaled GenAI safety evaluation, including multi-turn, agentic, and frontier safety assessments; develops LLM-as-a-judge autoraters and automated risk monitoring and governance.
Model-written summary · the original posting is authoritative