Technical Program Manager, AI2, TPU Software
Sunnyvale, CA, USA · Manager · Full-time · Posted Oct 19, 2026
- Experience
- 8 years of experience in program management; preferred: 8 years managing cross-functional or cross-team projects.
- Education
- Bachelor's degree in a technical field, or equivalent practical experience.
About the job
Leads strategy and execution for Google’s TPU software ecosystem, scaling AI training and inference infrastructure and improving platform performance, cost, and developer adoption.
What you'll do
- Develop end-to-end program strategies, plans, risk management, and roadmaps for ML infrastructure.
- Coordinate engineering, product, and research teams to define milestones, manage dependencies, and deliver platform capabilities.
- Report strategic recommendations to leadership and ensure production readiness and quality for hardware and software deployments.
What they ask for
- Bachelor's degree in a technical field, or equivalent practical experience.
- 8 years of experience in program management.
- Experience with artificial intelligence/machine learning projects, tools, or infrastructure.
Nice to have
- 8 years of experience managing cross-functional or cross-team projects.
- Experience with Jax and PyTorch frameworks, OSS models like Qwen and GLM, inference stacks like vLLM and SGLang, or production-facing large-scale software programs.
Pay
$192000 - $278000 USD base salary
Tools
TPU, Jax, PyTorch, Qwen, GLM, vLLM, SGLang
AI focus
Scales production-grade AI training and inference infrastructure; qualifies next-generation TPU hardware; advances orchestration for agentic workloads and tiered KV-cache management; expands support for multimodal, diffusion, physical AI, and world models; automates model onboarding and optimizes specialized kernel libraries.
Model-written summary · the original posting is authoritative