NVIDIA
Senior Software Architect, AI Systems and Networking
$224K–$431K
US, CA, Santa Clara +2 · Senior · Full-time · Posted Oct 29, 2026
- Location
- US, CA, Santa Clara
US, TX, Austin
US, CA, Remote - Experience
- 12+ years in systems software and/or networking.
- Education
- MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
About the job
Owns end-to-end research and production engineering for high-performance communication and memory systems that move data across GPUs, nodes, storage, and AI serving stacks.
What you'll do
- Architect and implement communication and memory-management libraries; optimize data movement across GPU memory, DRAM, NVMe, and networks.
- Drive hardware-software co-optimization and integrate networking capabilities into AI serving stacks.
- Maintain open-source projects, mentor engineers, conduct design reviews, and prototype experimental technologies.
What they ask for
- 12+ years in systems software and/or networking, with ownership of complex projects.
- MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
- Understanding of high-performance networking, including InfiniBand, RoCE, RDMA, NVLink, and GPUDirect.
- Strong C/C++/Rust systems programming, performance profiling, low-level debugging, and understanding of ML systems concepts.
Nice to have
- Knowledge of ML inference frameworks and their communication requirements.
- Knowledge of storage networking or a background in Reinforcement Learning systems.
Pay
224,000 USD - 356,500 USD base salary (Level 5); 272,000 USD - 431,250 USD base salary (Level 6)
Tools
InfiniBand, RoCE, RDMA, NVLink, GPUDirect, C/C++/Rust, vLLM, SGLang
AI focus
Builds and optimizes distributed AI communication and memory systems, integrates networking into AI inference stacks, and works with ML systems concepts.
Model-written summary · the original posting is authoritative