NVIDIA
Senior Research Engineer - Enterprise Products
$192K–$356K
US, WA, Remote +2 · Senior · Full-time · Posted Jul 10, 2026
- Location
- US, WA, Remote
US, CA, Santa Clara
US, Remote - Experience
- 8+ years of industry experience in Deep Learning frameworks.
- Education
- Bachelor's or Master's degree in Computer Science or equivalent experience.
About the job
Develop optimized generative AI inference technologies, including routing policies for LLM traffic across mixture-of-model systems, and evaluate them using benchmarks.
What you'll do
- Design and evaluate LLM traffic routing policies for mixture-of-model systems.
- Build and run agentic benchmarks, using results to create calibration data and routing profiles.
- Contribute design documents, code, reviews, and documentation to an open-source repository; collaborate across NVIDIA to integrate with its accelerated serving stack.
What they ask for
- Bachelor's or Master's degree in Computer Science or equivalent experience.
- 8+ years of industry experience in Deep Learning frameworks (PyTorch or TensorFlow).
- Experience designing or running LLM evaluations or benchmarks and drawing statistically sound conclusions.
- Understanding of modern Machine Learning, Deep Neural Networks, Natural Language Processing, or Speech Recognition techniques.
Nice to have
- Experience architecting or developing large-scale distributed systems for deep learning.
- Agentic benchmark creation and publications; knowledge of CPU and/or GPU architecture; GPU programming (CUDA).
Pay
192,000 USD - 304,750 USD base salary (Level 4); 224,000 USD - 356,500 USD base salary (Level 5)
Tools
PyTorch, TensorFlow, CUDA, Terminal-Bench
AI focus
Generative AI inference research and engineering, including LLM traffic routing, mixture-of-model systems, and agentic benchmarking.
Model-written summary · the original posting is authoritative