Amazon
Machine Learning Engineer, SageMaker AI Inference
$144K–$194K
Bellevue, WA · Full-time · Posted Oct 23, 2026
- Experience
- 3+ years professional software development; 2+ years design or architecture; 1+ years software development engineer or related occupational experience; 1+ years developing large-scale applications using a listed language; 1+ years Object Oriented Design.
- Education
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
About the job
Optimizes kernels and LLM inference systems to reduce latency and improve throughput in production SageMaker AI workloads.
What you'll do
- Design, implement, profile, benchmark, and tune kernel-level optimizations and inference pipelines.
- Write maintainable code, participate in code reviews, and mentor newer engineers.
- Collaborate across science, ML, and infrastructure teams to deliver production-ready inference solutions and evaluate optimization tools.
What they ask for
- 3+ years of non-internship professional software development experience.
- 2+ years of non-internship design or architecture experience for new and existing systems.
- 1+ years of experience developing large-scale software applications using C#, C++, Java, or Perl; 1+ years of Object Oriented Design experience.
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field; experience programming with at least one software programming language.
Nice to have
- Experience with CUDA kernels or ML/low-level kernels.
- Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and model execution optimization.
Pay
143,700.00 - 194,400.00 USD annually (base salary)
Tools
C#, C++, Java, Perl, CUDA
AI focus
Optimizes LLM inference performance, including kernel tuning, inference pipeline improvements, and evaluation of generative AI techniques.
Model-written summary · the original posting is authoritative