Amazon
Software Engineer II - AI/ML, AWS Neuron
$144K–$194K
Seattle, WA · Full-time · Posted Aug 31, 2026
- Experience
- 3+ years of non-internship professional software development experience; 3+ years of non-internship design or architecture experience.
- Education
- Bachelor's degree in computer science or equivalent.
About the job
Develop and optimize distributed inference support and high-performance ML workloads for large language models on AWS Trainium and Inferentia accelerators.
What you'll do
- Build and tune distributed inference solutions, kernels, and features for ML models on Neuron hardware.
- Profile and optimize system performance, including memory use, latency, throughput, and hardware-specific execution.
- Develop model enablement infrastructure and work with customers and cross-functional teams to deploy and optimize workloads.
What they ask for
- Bachelor's degree in computer science or equivalent.
- 3+ years of non-internship professional software development experience and 3+ years of non-internship design or architecture experience.
- Fundamentals of machine learning and LLMs, including architecture, training and inference lifecycles, and model execution optimization experience.
- Software development experience in C++ or Python; strong understanding of system performance, memory management, and parallel computing.
Nice to have
- Familiarity with PyTorch, JIT compilation, and AOT tracing.
- Experience with CUDA or equivalent kernels, or production inference serving platforms such as vLLM, SGLang, or TensorRT.
Pay
143,700.00 - 194,400.00 USD annually (base salary)
Tools
AWS Neuron SDK, Trainium, Inferentia, Python, C++, PyTorch, JAX, vLLM
AI focus
Enable, develop, and optimize distributed LLM inference and ML workloads on AWS custom accelerators, including performance tuning and high-performance kernel development.
Model-written summary · the original posting is authoritative