NVIDIA
Senior Product Manager - AI Platform Inference
$168K–$328K
US, CA, Santa Clara · Manager · Full-time · Posted Aug 5, 2026
- Experience
- 6+ years of technical product management, or similar, experience at a technology company.
- Education
- BS or MS degree in Computer Science, Computer Engineering, or similar experience (or equivalent experience).
About the job
Builds tools, SDKs, and libraries that help developers optimize and deploy AI inference on NVIDIA GPUs.
What you'll do
- Create products that help developers build better inference deployments.
- Develop product strategy, roadmaps, and go-to-market plans.
- Work with developers and leadership to shape model optimization software roadmaps and align with company strategy.
What they ask for
- Experience with inference deployment and optimization software.
- Demonstrable knowledge of GenAI or machine learning, especially performance optimization, and software development and delivery.
- BS or MS in Computer Science, Computer Engineering, or similar experience (or equivalent experience).
- Strong communication and interpersonal skills.
Nice to have
- Experience leading inference optimization products.
- Experience with open-source, GitHub-first developer products and deep customer interactions; knowledge of GPU architecture, HW/SW co-design, and performance profiling.
Pay
168,000 USD - 258,750 USD base salary (Level 4); 208,000 USD - 327,750 USD base salary (Level 5)
Tools
vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO
AI focus
Product management for AI inference tools and software, with emphasis on model optimization and inference deployment performance on NVIDIA GPUs.
Model-written summary · the original posting is authoritative