SambaNova
Software Architect
$245K–$325K
San Jose, California, United States · Full-time · Posted Jun 2, 2026
- Experience
- 12+ years of software engineering experience; significant time in a role with organization-wide technical influence.
About the job
Defines the technical direction and end-to-end architecture of SambaStack, an enterprise inference-serving platform for AI workloads.
What you'll do
- Own the platform’s architecture, addressing scalability, reliability, performance, and systemic risks.
- Set architectural strategy and standards; lead design reviews and guide cross-team technical decisions.
- Partner across engineering and product teams, mentor engineers, and assess technologies for the platform roadmap.
What they ask for
- 12+ years of software engineering experience, including significant time in a role with organization-wide technical influence.
- Proven ownership of large-scale distributed systems architectures from design through production.
- Expertise building backend systems in Python, Go, or Rust; expert-level Kubernetes knowledge, including Operators, Helm Charts, and cluster-scale resource management.
- Strong distributed-systems expertise and demonstrated ability to set technical direction across teams, align stakeholders, communicate clearly, and mentor engineers.
Nice to have
- Familiarity with AI inference serving, LLM infrastructure, custom hardware accelerators, or ML productionization.
- Experience building enterprise cloud-native platforms; familiarity with AI coding assistants or work at a high-growth AI infrastructure company.
Pay
$245,000 — $325,000 USD (base salary)
Tools
Python, Go, Rust, Kubernetes, Operators, Helm Charts
AI focus
Architects and evolves an AI inference-serving platform for production-scale foundation model and LLM workloads.
Model-written summary · the original posting is authoritative