Nio
AI Technical Lead
$192K–$250K
San Jose, CA · Hybrid · Full-time · Posted Jun 18, 2026
- Experience
- 8+ years with a Ph.D.; 12+ years with a Master’s degree.
- Education
- Ph.D. in Computer Science, Computer Engineering, Artificial Intelligence, or a related field; or Master’s degree.
About the job
Leads the technical vision and engineering team building resilient hybrid AI inference systems that distribute LLM and VLM workloads across edge devices and cloud infrastructure.
What you'll do
- Set the architecture and technical roadmap for hybrid inference systems and lead, mentor, and guide specialized engineers.
- Oversee high-availability orchestration, inference routing, fallback strategies, and telemetry for reliable operation across varying connectivity.
- Guide engineering across distributed systems, inference optimization, and AI compiler domains.
What they ask for
- Ph.D. in a related field with 8+ years of relevant industry experience, or a Master’s degree with 12+ years.
- Proven experience leading technical teams or driving complex architectural roadmaps.
- Deep hands-on mastery in one or two relevant domains, with breadth to lead across full-stack AI systems engineering.
- C++ and production-grade Python proficiency; understanding of edge/cloud model-serving frameworks and AI compilers.
Nice to have
- Expertise in privacy-preserving AI techniques, including federated learning, differential privacy, or secure enclaves.
- Relevant conference publications or active open-source ML infrastructure contributions.
Pay
$192,100.00 - $249,600.00 USD base salary
Tools
C++, Python, vLLM, TensorRT-LLM, ExecuTorch, MLC-LLM, MLIR, Apache TVM
AI focus
Hybrid LLM/VLM inference across edge and cloud, including routing, model optimization, and resilient orchestration.
Model-written summary · the original posting is authoritative