Amazon
Applied Science Manager, Artificial General Intelligence , Frontier AI Assets: Assessments
$184K–$249K
BELLEVUE, WA +2 · Manager · Full-time · Posted Jul 28, 2026
- Location
- BELLEVUE, WA
Boston, MA
Bellevue, WA - Experience
- 3+ years of scientists or machine learning engineers management experience
About the job
Leads a team developing data-quality strategies, auditing frameworks, and automated evaluation systems for training and evaluation data used by Amazon Nova models and LLM products.
What you'll do
- Lead and mentor Applied Scientists; oversee hiring, development, performance reviews, and team growth.
- Design and manage data audits, quality metrics, sampling methods, root-cause analysis, and data-collection workflows.
- Oversee LLM-as-a-Judge systems and communicate quality feedback, technical designs, and product strategy to stakeholders.
What they ask for
- 3+ years of scientists or machine learning engineers management experience
- Knowledge of ML, NLP, Information Retrieval and Analytics
Nice to have
- Experience building machine learning models or developing algorithms for business application
- Experience building complex software systems, especially involving deep learning, machine learning and computer vision, that have been successfully delivered to customers
Pay
183,800.00 - 248,700.00 USD annually (base salary); 183,800.00 - 248,700.00 USD annually (base salary)
Tools
Large Language Models (LLMs), multimodal systems, Amazon Nova models, LLM-as-a-Judge, ML, NLP, Information Retrieval
AI focus
Leads development of LLM and multimodal training and evaluation data quality processes, including automated LLM-as-a-Judge systems, evaluation rubrics, and machine-learning models for quality assessment.
Model-written summary · the original posting is authoritative