Software Development Engineer, Amazon Search Navigation AI

What you'll do

• Design, build, and operate large-scale, low-latency distributed services and optimize online LLM serving for latency, reliability, and cost.
• Partner with Applied Scientists and product teams to bring models into production, and build data pipelines for model training and evaluation.
• Run A/B experiments and support operational excellence through monitoring, on-call, code quality, and service guardrails.

What they ask for

• 3+ years of non-internship professional software development experience.
• 3+ years of non-internship design or architecture experience with design patterns, reliability, and scaling of new and existing systems.
• 3+ years of experience designing and developing large-scale software applications, tools, systems, and services using C#, C++, Java, or Perl.
• 3+ years of Object Oriented Design experience and experience programming in at least one software programming language.

Nice to have

• Bachelor's degree in computer science or equivalent.
• Experience deploying LLMs in production on AI acceleration hardware, or experience in machine learning, information retrieval, statistics, natural language processing, or LLM fundamentals.

Pay

143,700.00 - 194,400.00 USD annually (base salary)

Tools

C#, C++, Java, Perl, LLMs, GPUs, Neuron, TPU

AI focus

Develop real-time LLM serving for personalized Smart Refinement and multi-turn conversational refinement; productionize models with Applied Scientists and optimize inference latency, reliability, and cost.