Technical Product Manager - GenAI Platforms - AI Infrastructure - CTO Office

What you'll do

• Set the AI infrastructure vision and roadmap, evaluating models, providers, cloud platforms, serving technologies, and accelerators.
• Translate AI teams’ needs into reusable platform capabilities and partner with engineering to deliver scalable, resilient architecture.
• Establish metrics and strategies to improve AI workload latency, throughput, availability, utilization, capacity, and cost efficiency.

What they ask for

• 5+ years of technical product management experience, ideally in AI, platform, cloud, compute, or infrastructure domains.
• Experience building, operating, or product managing large-scale platform infrastructure for internal or external developers.
• Experience with public cloud platforms such as AWS, GCP, or Azure, and familiarity with hybrid or multi-cloud architecture.
• Strong understanding of distributed systems, service-to-service communication, API Gateways, Kubernetes, cloud-native architectures, and service reliability.

Nice to have

• Degree in Computer Science, Engineering, or a related technical discipline, or prior equivalent practical experience.
• Experience with GPU or accelerator infrastructure, AI infrastructure platforms, MLOps, or inference and training platforms.

Pay

140,000 - 295,000 USD Annual (base salary)

Tools

AWS, GCP, Azure, API Gateways, Kubernetes

AI focus

Product management for infrastructure supporting AI and GenAI workloads, including model access, deployment, serving, reliability, and scaling.