Director of Product

What you'll do

• Set the platform vision and roadmap across model serving, deployment, orchestration, APIs, and developer capabilities.
• Partner with engineering, research, and customers to shape inference capabilities and prioritize performance, reliability, usability, and cost.
• Lead product initiatives and teams, establish planning and measurement practices, and use customer and performance data to guide priorities.

What they ask for

• 10+ years of product management experience, including significant ownership of technically complex platforms or infrastructure products.
• Proven product strategy experience in AI/ML infrastructure, cloud platforms, distributed systems, developer platforms, or related technical products.
• Deep understanding of AI inference and LLM serving architectures, including prefill vs. decode, KV cache, token streaming, batching, routing, and GPU utilization.
• Experience leading product execution and adoption, developing Product Managers or coordinating workstreams, and working directly with enterprise customers and technical users.

Nice to have

• Experience with AI inference platforms, LLM serving, GPU infrastructure, or model deployment; familiarity with vLLM, TensorRT-LLM, SGLang, or similar technologies.
• Experience building developer platforms, APIs, SDKs, cloud-native infrastructure, multi-tenant SaaS, or enterprise AI platforms.

Tools

vLLM, TensorRT-LLM, SGLang

AI focus

Lead product strategy for AI inference, LLM serving, and production workloads including multimodal models and agentic applications.