Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

What you'll do

• Optimize distributed training throughput, model FLOPs utilization, and time to convergence across Neuron.
• Enable new model architectures on Trainium and develop parallelism strategies, operators, sharding, and numerics for correct, efficient training.
• Profile workloads, drive fixes across software layers, influence future Trainium architecture, and contribute upstream to open-source frameworks.

What they ask for

• Bachelor's degree in computer science or equivalent.
• 5+ years of non-internship professional software development experience, including 5+ years programming in at least one language.
• 5+ years leading design or architecture of new and existing systems, and 5+ years of full software development life cycle experience.
• Experience mentoring, serving as a tech lead or leading an engineering team; experience in machine learning, data mining, information retrieval, statistics or natural language processing.

Nice to have

• Master's degree in computer science or equivalent; experience in computer architecture.
• Software engineering expertise with Pytorch/Jax/Tensorflow, distributed libraries and frameworks, or end-to-end model training.

Pay

193,300.00 - 261,500.00 USD annually (base salary)

Tools

AWS Neuron, Trainium, PyTorch, JAX, Neuron compiler, Neuron runtime, Tensorflow

AI focus

Enables and optimizes large-scale machine learning and Generative AI training on Trainium, including model enablement, parallelism strategies, and reduced-precision formats.