Senior Engineering Analyst, AI Answers, Google Search
Seattle, WA, USA +4 · Senior · Full-time · Posted Oct 29, 2026
- Location
- Seattle, WA, USA
Atlanta, GA, USA
Austin, TX, USA
Kirkland, WA, USA
Washington D.C., DC, USA - Experience
- 5 years in data analysis and 5 years in the anti-abuse domain.
- Education
- Bachelor's degree or equivalent practical experience.
About the job
Leads the design and scaling of automated safety evaluation and enforcement systems for generative AI products, supporting ongoing testing and real-time launch decisions.
What you'll do
- Develop metrics, datasets, benchmarks, and evaluations to assess and improve Search, Labs, and Assistant products.
- Build and scale LLM-as-a-judge autoraters and automated evaluation systems for continuous regression testing and launch decisions.
- Coordinate technical roadmaps and integrations with product and engineering teams; analyze risks and improve operational workflows.
What they ask for
- Bachelor's degree or equivalent practical experience.
- 5 years of experience in data analysis, including identifying trends, generating summary statistics, and interpreting quantitative and qualitative data.
- 5 years of experience in the anti-abuse domain, focused on signal analysis, model development, data analysis, and cyber security.
- Programming experience in one or more languages, such as SQL, Python, or Golang.
Nice to have
- Experience with fraud or abuse investigations, risk management, security, and threat analysis for communication products.
- Proficiency in large-scale data analysis and in building ML reputation models.
Pay
USD 159000 - 230000 (base salary)
Tools
SQL, Python, Golang
AI focus
Generative AI safety and integrity: building LLM-as-a-judge autoraters and automated evaluation and enforcement systems, including continuous testing and real-time launch decisions.
Model-written summary · the original posting is authoritative