Amazon
Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training
$193K–$262K
Cupertino, CA · Senior · Full-time · Posted Jan 27, 2026
- Experience
- 5+ years in several areas as specified above; alternatives are not stated.
- Education
- Bachelor's degree in computer science or equivalent.
About the job
Develops and optimizes large-scale distributed ML training on AWS Trainium, including framework extensions, precision techniques, and end-to-end performance tuning.
What you'll do
- Design, implement, and optimize distributed training solutions for large ML models on Trainium.
- Extend and optimize FSDP, torchtitan, and Hugging Face libraries for the Neuron ecosystem; develop mixed- and low-precision training techniques.
- Profile and tune training pipelines, collaborate with hardware, compiler, and runtime teams, and help customers deploy workloads at scale.
What they ask for
- Bachelor's degree in computer science or equivalent.
- 5+ years of non-internship professional software development experience, programming experience, and full software development life cycle experience.
- 5+ years leading design or architecture of new and existing systems.
- Experience mentoring, serving as a tech lead, or leading an engineering team; experience in machine learning, large-scale LLM training, and expertise in PyTorch.
Nice to have
- Master's degree in computer science or equivalent.
- Experience in computer architecture; software engineering expertise with PyTorch/Jax/Tensorflow, distributed libraries and frameworks, and end-to-end model training.
Pay
193,300.00 - 261,500.00 USD annually (base salary)
Tools
AWS Trainium, AWS Neuron, FSDP (Fully-Sharded Data Parallel), torchtitan, Hugging Face libraries, BF16, FP8, PyTorch
AI focus
Large-scale pre-training and post-training of LLMs, multimodal transformer and diffusion models, and reinforcement learning workloads; distributed training and mixed-/low-precision optimization.
Model-written summary · the original posting is authoritative