Amazon
Applied Scientist, Artificial General Intelligence, Frontier AI
$136K–$184K
BELLEVUE, WA +1 · Full-time · Posted Sep 14, 2026
- Location
- BELLEVUE, WA
Bellevue, WA - Education
- Master's degree in computer science, mathematics, statistics, machine learning or equivalent quantitative field
About the job
Develops quality strategies, auditing frameworks, and automated evaluation systems for data workflows supporting Amazon Nova models and other LLM products.
What you'll do
- Design auditing strategies, quality metrics, sampling methods, and data collection workflows; perform manual audits and assess auditor performance.
- Develop and maintain LLM-as-a-Judge systems, including judge architectures, evaluation rubrics, and machine learning models for automated quality assessment.
- Investigate data quality issues, research auditing methods, coach auditors, and communicate quality feedback to stakeholders.
What they ask for
- Master's degree in computer science, mathematics, statistics, machine learning, or equivalent quantitative field.
- Programming experience in Java, C++, Python, or a related language.
- Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse.
Nice to have
- Experience implementing algorithms using both toolkits and self-developed code.
- Publications at top-tier peer-reviewed conferences or journals.
Pay
136,000.00 - 184,000.00 USD annually (base salary)
Tools
Java, C++, Python, SQL, Oracle, Large Language Models (LLMs)
AI focus
Build and evaluate LLM and multimodal systems; develop LLM-as-a-Judge systems and automated quality assessment models for training and evaluation data.
Model-written summary · the original posting is authoritative