Sr. Software Engineer- AI/ML, Amazon Neuron Training

What you'll do

• Build distributed training and post-training support in PyTorch and JAX for Trainium.
• Own parallelism strategies and optimize large-scale training, post-training, and reinforcement learning workloads across the Neuron software stack.
• Profile workloads, drive performance fixes across software layers, and translate gaps into framework requirements and open-source contributions.

What they ask for

• 5+ years of non-internship professional software development experience.
• 5+ years of programming experience with at least one software programming language.
• 5+ years leading design or architecture of new and existing systems, including design patterns, reliability, and scaling.
• Experience as a mentor, tech lead, or engineering team lead; familiarity with LLM/transformer fundamentals; experience in machine learning, data mining, information retrieval, statistics, or natural language processing.

Nice to have

• Master's degree or above in computer science or equivalent.
• Experience deploying LLMs, SFT or RLHF/PPO/DPO, ML frameworks or distributed training, performance engineering, computer architecture, or open-source contributions.

Pay

193,300.00 - 261,500.00 USD annually (base salary)

Tools

PyTorch, JAX, AWS Trainium, Neuron, GPUs, TPU

AI focus

Distributed training and post-training for LLMs, including reinforcement learning and fine-tuning, on Trainium; performance optimization and parallelism strategies.