Amazon
Sr. ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs
$193K–$262K
Cupertino, CA · Senior · Full-time · Posted Sep 1, 2026
- Experience
- 5+ years for the stated software development, programming, system design/architecture, and full software development life cycle qualifications; preferred qualifications also list 6+ years of full software development experience.
- Education
- Bachelor's degree in computer science or equivalent (preferred).
About the job
Designs and optimizes high-performance machine-learning kernels and compiler features for AWS Neuron accelerators, while enabling customer models and collaborating across hardware and software teams.
What you'll do
- Design and implement high-performance compute kernels for ML operations and optimize them across Neuron hardware generations.
- Profile performance and implement compiler optimizations such as fusion, sharding, tiling, and scheduling.
- Work with customers and cross-functional teams to enable and optimize ML workloads on AWS accelerators.
What they ask for
- 5+ years of non-internship professional software development experience.
- 5+ years of programming experience in at least one software programming language.
- 5+ years leading design or architecture of new and existing systems, including design patterns, reliability, and scaling.
- 5+ years of full software development life cycle experience; experience as a mentor, tech lead, or engineering team lead.
Nice to have
- Bachelor's degree in computer science or equivalent.
- Experience with accelerator architectures, GPU kernel optimization, high-performance computing, or low-level performance optimization.
Pay
193,300.00 - 261,500.00 USD annually (base salary)
Tools
Neuron, CUDA, NKI, Triton, OpenCL, SYCL, ROCm, LLVM/MLIR
AI focus
Accelerates deep learning and GenAI workloads by developing and optimizing ML kernels and enabling models on AWS Inferentia and Trainium accelerators.
Model-written summary · the original posting is authoritative