Software Development Manager, SageMaker Training

What you'll do

• Own the team's charter, roadmap, technical direction, and decisions about what to build.
• Hire, develop, and retain engineers, partnering with senior engineers, applied scientists, and product managers.
• Own production service health and improve training throughput and cost across accelerator fleets.

What they ask for

• 3+ years of engineering team management experience.
• 7+ years of working directly within engineering teams experience.
• 5+ years of designing or architecting new and existing systems, including design patterns, reliability, and scaling.
• Knowledge of full software/hardware/networks development life-cycle practices; experience partnering with product or program management teams and recruiting, hiring, mentoring/coaching, and managing Software Engineers.

Nice to have

• Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and model execution optimization.
• Experience with PyTorch, JIT compilation, and AOT tracing; deep learning libraries, production LLM deployment, or large-scale machine learning systems.

Pay

212,700.00 - 287,700.00 USD annually (base salary)

Tools

PyTorch, Verl, FSDP, Megatron, vLLM, TensorFlow, MxNet, Neuron

AI focus

Leads development of managed post-training and model-customization services, including reinforcement learning and agentic training; improves training performance and cost on accelerator fleets.