Staff Software Engineer, Emerging On-Prem AI Infrastructure
Sunnyvale, CA, USA · Staff · Full-time · Posted Oct 23, 2026
- Experience
- 8 years programming in C++; 5 years testing and launching software products; 5 years in large-scale infrastructure, distributed systems, networks, compute technologies, storage, or hardware architecture; 3 years in software design and architecture.
- Education
- Bachelor's degree or equivalent practical experience.
About the job
Leads development of new on-prem AI infrastructure, including integrated hardware and software systems, workload management, and large-scale training and inference performance.
What you'll do
- Set technical goals and roadmaps, mentor engineers, and scope ambiguous problems into deliverable projects.
- Design and lead test infrastructure, diagnostics, troubleshooting, and supportability tools and repair automation.
- Drive team success metrics for release quality and customer-facing operations; deliver features across teams.
What they ask for
- Bachelor's degree or equivalent practical experience.
- 8 years of experience programming in C++.
- 5 years of experience testing and launching software products.
- 5 years building large-scale infrastructure, distributed systems, or networks, or experience with compute technologies, storage, or hardware architecture; 3 years of software design and architecture experience.
Nice to have
- Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
- 3 years in a technical leadership role leading project teams and setting technical direction; experience with deep system skills, large-scale fleet operations, or low-level systems, networking, or hardware.
Pay
USD 207000 - 300000 base salary
Tools
C++, TPUs, Vertex AI
AI focus
Build on-prem AI infrastructure for AI solution builders, including large-scale training and inference workloads and performance optimization.
Model-written summary · the original posting is authoritative