Senior Manager, Engineering - AI Inference

What you'll do

• Lead team delivery, technical strategy, and roadmaps from experiments through production.
• Profile and optimize inference serving architectures and stacks for latency, throughput, cost, and reliability.
• Partner with customers to tailor deployments and take workloads from proof of concept to monitored production services.

What they ask for

• 2+ years of direct engineering team management in a high-performance or ML-focused environment.
• Strong hands-on experience in software engineering, low-level optimization, or ML infrastructure, including production coding in a general-purpose language.
• Familiarity with LLM inference optimization, serving frameworks, performance profiling to kernel level, and GPU behavior.
• Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or a related field.

Nice to have

• Python is strongly preferred.
• Experience with CUDA or comparable technologies, Docker and Kubernetes, or customer-facing AI/ML projects.

Pay

up to $250,000 - $300,000 USD base salary + Bonus; Restricted Stock Units are included in all offers (amount not stated)

Tools

vLLM, SGLang, CUDA, Python, C++, Docker, Kubernetes

AI focus

Applies and optimizes large language model inference techniques for production deployments, including serving architecture, performance profiling, and customer-specific workload tuning.