Otter.ai
Senior Software Engineer, AI Agent & LLM
$185K–$230K
Mountain View, CA · Senior · Full-time · Posted Jul 22, 2026
- Experience
- 5+ years of AI Agent engineering, machine learning engineering, or related experience.
About the job
Build and improve Otter’s AI-agent experiences and conversational knowledge systems, including evaluation and shared infrastructure, to deliver reliable production capabilities.
What you'll do
- Build AI-agent experiences for Otter AI Chat and advance knowledge extraction, annotation, and indexing.
- Develop evaluation datasets, automated graders, regression tests, release gates, and shared agent infrastructure.
- Diagnose failures and improve task completion, correctness, groundedness, reliability, latency, and cost using production signals.
What they ask for
- 5+ years of AI Agent engineering, machine learning engineering, or related experience.
- Strong backend or distributed-systems engineering skills.
- Hands-on experience building and shipping AI-agent or LLM-powered products.
- Experience evaluating nondeterministic systems and using data, traces, logs, and qualitative examples to resolve failures.
Nice to have
- Ability to use coding agents effectively while rigorously reviewing and controlling output quality.
Pay
$185,000 to $230,000 USD per year (base salary)
AI focus
Build and improve AI agents, LLM-powered products, conversational knowledge systems, and evaluation and quality infrastructure.
Model-written summary · the original posting is authoritative