Amazon
SDE II, ML Infra Services, Annapurna Labs
$144K–$194K
Seattle, WA · Full-time · Posted Oct 27, 2026
- Experience
- 3+ years of non-internship software development; 2+ years of non-internship design or architecture; 2+ years developing large-scale distributed software applications, tools, systems, and services.
- Education
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
About the job
Leads development of ML infrastructure and tools that manage, schedule, and optimize workloads across AWS ML accelerators.
What you'll do
- Design and implement capacity management, workload scheduling, and fleet orchestration for ML accelerators.
- Develop tools to run, optimize, and analyze machine-learning workloads, improving accelerator access, utilization, and wait times.
- Create metrics and automation, resolve software defects, and collaborate with scientists, infrastructure engineers, hardware teams, and customers.
What they ask for
- 3+ years of non-internship professional software development experience.
- 2+ years of non-internship design or architecture experience for new and existing systems.
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
- Experience with large-scale distributed systems and 2+ years developing multi-tiered, multi-threaded distributed applications, tools, systems, and services in Go, Java, or Rust.
Nice to have
- Experience debugging and profiling large-scale systems; Kubernetes/EKS experience.
- Experience leading teams or organizations; operational ownership of production services.
Pay
143,700.00 - 194,400.00 USD annually (base salary)
Tools
Go, Java, Rust, Kubernetes/EKS, Python, JavaScript/TypeScript
AI focus
Develops ML infrastructure and tools for running, optimizing, and analyzing workloads on AWS Inferentia and Trainium accelerators.
Model-written summary · the original posting is authoritative