Sr. Software Development Engineer, AI/ML, AWS Neuron, Model Inference

What you'll do

• Design and implement distributed inference features, high-performance kernels, and model enablement in the Neuron SDK.
• Profile and optimize model and system performance, including latency, throughput, memory use, and hardware-specific execution.
• Collaborate across engineering teams and with customers to deploy and tune machine learning workloads.

What they ask for

• Bachelor's degree in computer science or equivalent.
• 5+ years of non-internship professional software development experience, programming experience, and leading system design or architecture.
• Experience as a mentor, tech lead, or engineering team lead.
• Machine learning and LLM fundamentals, model execution optimization experience, and software development experience in C++ or Python.

Nice to have

• Master's degree in computer science or equivalent.
• Familiarity with PyTorch, JIT compilation, AOT tracing, CUDA or low-level kernels, Triton-like semantics, or inference-serving platforms such as vLLM, SGLang, and TensorRT.

Pay

193,300.00 - 261,500.00 USD annually (base salary)

Tools

AWS Neuron, Trainium, Inferentia, Python, C++, PyTorch, JAX, vLLM

AI focus

Build and optimize distributed inference for LLMs and other machine learning models on AWS custom accelerators, including model enablement, high-performance kernels, and performance tuning.