Amazon
Sr. Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs, Annapurna Labs
$168K–$262K
Seattle, WA +1 · Senior · Full-time · Posted Jul 21, 2026
- Location
- Seattle, WA
Cupertino, CA - Experience
- 5+ years in each of the specified software development, programming, systems design or architecture, and full software development lifecycle areas.
- Education
- Bachelor's degree in computer science or equivalent (preferred).
About the job
Build and optimize high-speed networking and data-movement software for disaggregated AI inference, transferring LLM KV cache across accelerators, servers, and memory at large scale.
What you'll do
- Develop low-level data-movement software across accelerators, servers, and heterogeneous memory over AWS networking.
- Profile systems and optimize performance toward hardware limits.
- Work across kernels, network transport, and inference frameworks with chip, runtime, and model teams.
What they ask for
- 5+ years of non-internship professional software development experience.
- 5+ years of programming experience with at least one software programming language.
- 5+ years leading design or architecture of new and existing systems, including design patterns, reliability, and scaling.
- 5+ years of full software development lifecycle experience; mentoring, tech lead, or engineering team leadership experience; C/C++ coding experience.
Nice to have
- Bachelor's degree in computer science or equivalent.
- ML communications experience (NCCL, NIXL, NVSHMEM).
Pay
USD 193,300.00 - 261,500.00 annually, base salary; USD 168,100.00 - 227,400.00 annually, base salary
Tools
C/C++, Linux, RDMA, InfiniBand, libfabric, UCX, NIXL, MPI
AI focus
Develop networking and data-transfer software for disaggregated LLM inference, including moving KV cache between prefill and decode pools.
Model-written summary · the original posting is authoritative