NVIDIA
Manager, Software Architecture
$184K–$356K
US, CA, Santa Clara · Manager · Full-time · Posted Jul 21, 2026
- Experience
- 8+ years overall software engineering experience; 3+ years direct people management experience.
- Education
- BS, MS, PhD or equivalent experience in Computer Science, Computer Engineering, or a related field.
About the job
Leads an applied research engineering team building distributed AI communication systems, while setting technical direction and owning execution.
What you'll do
- Lead and develop systems and networking engineers building libraries, frameworks, and system integrations.
- Set the technical roadmap with principal engineers and architects, balancing delivery with longer-term research.
- Manage project planning, resource allocation, delivery timelines, and team culture across concurrent workstreams.
What they ask for
- 8+ years of software engineering experience, with advanced knowledge of systems software, networking, or distributed systems.
- 3+ years of direct people management experience.
- BS, MS, PhD or equivalent experience in Computer Science, Computer Engineering, or a related field.
- Proficiency in programming languages such as C, C++, Rust and Python.
Nice to have
- Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements.
- Familiarity with hardware and software ecosystems; experience with agile methodologies adapted for research engineering teams.
Pay
184,000 USD - 287,500 USD (base salary, Level 2); 224,000 USD - 356,500 USD (base salary, Level 3)
Tools
C, C++, Rust, Python, vLLM, SGLang, TensorRT-LLM
AI focus
Leads development of distributed AI communication systems and works with ML systems concepts, including transformer architectures, KV cache mechanics, model parallelism, and distributed training and inference patterns.
Model-written summary · the original posting is authoritative