Amazon
Applied Scientist, Artificial General Intelligence, Foundational AI
$136K–$184K
BELLEVUE, WA +2 · Full-time · Posted Aug 26, 2026
- Location
- BELLEVUE, WA
Boston, MA
Bellevue, WA - Education
- Master's degree in computer science, mathematics, statistics, machine learning, or equivalent quantitative field.
About the job
Develops data-quality strategies, auditing frameworks, and automated evaluation systems for training and evaluating Amazon Nova models and other LLM products.
What you'll do
- Design data-auditing strategies, SOPs, quality metrics, and sampling methods; perform manual audits and assess auditor performance.
- Develop and maintain LLM-as-a-Judge systems, including judge architectures, evaluation rubrics, and automated quality-assessment models.
- Analyze data-quality issues, configure data-collection workflows, and communicate quality feedback to stakeholders.
What they ask for
- Master's degree in computer science, mathematics, statistics, machine learning, or an equivalent quantitative field.
- Programming experience in Java, C++, Python, or a related language.
- Experience with SQL and an RDBMS (e.g., Oracle) or Data Warehouse.
Nice to have
- Experience implementing algorithms using toolkits and self-developed code.
- Publications at top-tier peer-reviewed conferences or journals.
Pay
136,000.00 - 184,000.00 USD annually (base salary)
Tools
Large Language Models (LLMs), Java, C++, Python, SQL, Oracle
AI focus
Builds and evaluates Amazon Nova models and LLM products through training-data quality assurance, multimodal systems, and LLM-as-a-Judge automation.
Model-written summary · the original posting is authoritative