Boson Ai
Senior Software Engineer - Systems
$180K–$400K
Santa Clara HQ · On-site · Senior · Full-time · Posted Jul 8, 2026
- Experience
- 3+ years building and operating backend systems at scale.
About the job
Build and operate the core platform infrastructure powering Boson AI’s model APIs and agentic products, with a focus on performance, reliability, and developer usability.
What you'll do
- Own platform services including API serving, state management, policy enforcement, and agentic execution runtime.
- Build distributed services and data pipelines for model APIs, usage analytics, and billing.
- Develop internal SDKs and context-retrieval systems, and improve platform observability and reliability.
What they ask for
- 3+ years building and operating backend systems at scale.
- Strong distributed-systems fundamentals, including concurrency, fault tolerance, consistency tradeoffs, and capacity planning.
- Hands-on data-pipeline infrastructure experience; API or framework design adopted by other teams; and proficiency in a systems language or Python in a performance-sensitive context.
- Experience across cloud infrastructure, containerized deployments, CI/CD, and production on-call.
Nice to have
- Experience with LLM serving, agentic orchestration, or RAG pipelines; familiarity with MCP, A2A, LangChain, or LlamaIndex.
- Background in real-time media systems or high-stakes platform services.
Pay
USD 180,000–400,000 (per-year-salary); base salary
Tools
Kafka/Kinesis, Spark/Flink, Airflow, Go, Rust, Java, C++, Python
AI focus
Build platform infrastructure for model APIs and agentic products, including context and memory systems; collaborate on model serving and voice runtime integration.
Model-written summary · the original posting is authoritative