Harvey
Staff Software Engineer, AI Platform
$231K–$340K
San Francisco · Hybrid · Staff · Full-time · Posted Apr 24, 2026
- Experience
- 10+ years building backend systems, with at least 1+ year focused on AI/ML engineering.
About the job
Build the shared AI platform and agent infrastructure that powers Harvey’s products, including model routing, context management, and evaluation systems.
What you'll do
- Design and build platform abstractions and systems for Harvey’s agentic products.
- Own infrastructure for model integration, routing, and evaluation; build tooling to improve AI quality.
- Partner with product teams to launch AI products and evaluate, prototype, and integrate advances in AI.
What they ask for
- 10+ years building backend systems, including at least 1+ year focused on AI/ML engineering, with technical leadership across teams.
- Experience building and shipping multi-model or multi-provider AI systems in production.
- Familiarity with AI or distributed-systems context management, session state, or memory systems.
- Experience building internal platforms, SDKs, or shared infrastructure adopted by other engineering teams.
Nice to have
- Experience building evaluation frameworks or working with agent/function-calling architectures.
- Familiarity with legal or other high-stakes professional-services domains, or experience at early-stage or hyper-growth startups.
Pay
$231,000 - $340,000 (base salary); $231K – $340K (compensation; type not specified)
AI focus
Build agent infrastructure and shared AI systems, including context management, session state and memory, foundation-model integration and routing, and evaluation frameworks; prototype and integrate advances in AI and agentic systems.
Model-written summary · the original posting is authoritative