Amazon
Applied Scientist, Customer Experience and Business Trends, Customer Experience and Business Trends
$143K–$193K
Seattle, WA · Full-time · Posted Sep 10, 2026
- Experience
- 3+ years of building models for business application experience; PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience.
- Education
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience.
About the job
Develops scientific methods and systems to evaluate autonomous coding agents building on AWS, measuring their behavior and the quality of their outcomes.
What you'll do
- Develop reproducible experiments, methodologies, and metrics for evaluating agent behavior, decisions, and outputs.
- Apply cloud architecture knowledge to analyze agents’ architectural choices and trade-offs.
- Build and deploy evaluation models and systems, and publish or present scientific work.
What they ask for
- 3+ years of building models for business application experience.
- PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience.
- Experience in patents or publications at top-tier peer-reviewed conferences or journals.
- Programming experience in Java, C++, Python or related language; hands-on experience building GenAI ML models for NLP tasks.
Nice to have
- Deep working knowledge of cloud architecture and services, including production trade-offs.
- Experience with agentic/tool-using systems, LLM-based agents, autonomous-agent evaluation, or AWS Redshift, EMR, Spark, and Sagemaker.
Pay
142,800.00 - 193,200.00 USD annually (base salary)
Tools
Java, C++, Python, AWS Redshift, EMR, Spark, Sagemaker, GenAI
AI focus
Research and develop behavioral evaluation methods, experiments, and metrics for autonomous tool-using agents and their AWS-built outcomes, emphasizing evidence-grounded, reliable conclusions.
Model-written summary · the original posting is authoritative