SambaNova
Senior Director of Engineering - Inference Serving
$245K–$325K
San Jose, California, United States · Director · Full-time · Posted Jun 2, 2026
- Experience
- 12+ years of software engineering experience, including 2+ years leading and managing engineering teams.
About the job
Leads and develops the SambaStack engineering team, owns the inference-serving platform roadmap, and contributes hands-on to designing and building production systems for AI workloads.
What you'll do
- Lead hiring, development, execution, and technical effectiveness of the engineering team.
- Design systems, write code, and guide implementation and technical reviews for critical platform work.
- Drive platform reliability, performance, scalability, engineering standards, and cross-functional alignment.
What they ask for
- 12+ years of software engineering experience, including 2+ years leading and managing engineering teams.
- Strong backend systems expertise with Python, Go, or Rust.
- Experience with AI inference serving, orchestration, and production-scale LLM infrastructure.
- Demonstrated ability to manage, develop, and hire engineers while remaining hands-on; proven engineering excellence and effective communication.
Nice to have
- Experience with Kubernetes ecosystem tooling, including Operators and Helm Charts; background in ML application optimization and productionization.
- Experience delivering cloud-native enterprise platforms, familiarity with AI coding assistants, or experience at a high-growth AI infrastructure company.
Pay
$245,000 — $325,000 USD (base salary)
Tools
Python, Go, Rust, Kubernetes, Operators, Helm Charts
AI focus
Leads and contributes to production AI inference serving, orchestration, and infrastructure for LLM workloads; stays current on AI inference trends.
Model-written summary · the original posting is authoritative