SDE, Neuron Inference, Neuron Inference

What you'll do

• Develop and optimize LLM inference building blocks, including attention, MLP, quantization, speculative decoding, and mixture of experts.
• Adapt LLM optimization research to Neuron chips for open-source and internal models.
• Collaborate with chip architects, compiler engineers, runtime engineers, and other teams.

What they ask for

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience for new and existing systems.
• At least 1 year designing and developing large-scale, multi-tiered, multi-threaded, embedded, or distributed software using C#, C++, Java, or Perl; and at least 1 year of Object Oriented Design experience.
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field; experience programming with at least one software language.

Nice to have

• 3+ years of full software development life cycle experience.
• Bachelor's degree in computer science or equivalent.

Pay

143,700.00 - 194,400.00 USD annually (base salary)

Tools

AWS Neuron, AWS Inferentia, Trainium, C#, C++, Java, Perl

AI focus

Optimize LLM inference on AWS Neuron accelerators, including attention, MLP, quantization, speculative decoding, and mixture-of-experts; apply research to improve model performance and accuracy.