Software Development Engineer, AI/ML, AWS Neuron, Model Inference

What you'll do

• Build distributed inference support and tune large language models for performance on AWS accelerators.
• Design, implement, profile, and test high-performance ML kernels, system features, and model onboarding infrastructure.
• Collaborate with customers and compiler, runtime, framework, and hardware teams to enable and optimize workloads.

What they ask for

• Bachelor's degree in computer science or equivalent.
• 3+ years of non-internship professional software development experience and 3+ years of non-internship system design or architecture experience.
• Fundamentals of machine learning and LLMs, including experience with model-execution optimizations.
• Software development experience in C++ or Python; strong system-performance, memory-management, parallel-computing, and debugging/profiling knowledge.

Nice to have

• Master's degree or Ph.D. in Computer Science or equivalent; familiarity with PyTorch, JIT compilation, and AOT tracing.
• Experience with CUDA or other low-level kernels, Triton-like tile semantics, or production inference serving platforms such as vLLM, SGLang, or TensorRT.

Pay

165,200.00 - 223,600.00 USD annually (base salary)

Tools

AWS Neuron, Trainium, Inferentia, C++, Python, PyTorch, JAX, CUDA

AI focus

Develop and accelerate distributed LLM inference, model enablement, and high-performance kernels on custom ML accelerators.