Harvey
Staff Software Engineer, AI Platform
$231K–$340K
New York · Hybrid · Staff · Full-time · Posted Jul 16, 2026
- Experience
- 10+ years building backend systems, including at least 1+ year focused on AI/ML engineering.
About the job
Build shared AI platform systems and infrastructure that support Harvey’s agents and products, including model routing, context management, and evaluation.
What you'll do
- Design platform abstractions and systems for agentic products, including model integration, routing, and evaluation.
- Build shared evaluation frameworks and tooling to help teams measure and improve AI quality.
- Partner with product teams to launch AI products and evaluate, prototype, and integrate advances in AI and agentic systems.
What they ask for
- 10+ years building backend systems, including at least 1+ year focused on AI/ML engineering, with technical leadership across teams.
- Experience building and shipping multi-model or multi-provider AI systems in production.
- Familiarity with AI or distributed-systems context management, session state, or memory systems.
- Track record building internal platforms, SDKs, or shared infrastructure adopted by other engineering teams.
Nice to have
- Experience building evaluation frameworks or working with agent/function-calling architectures.
- Familiarity with legal or other high-stakes professional-services domains, or experience at early-stage or hyper-growth startups.
Pay
$231,000 - $340,000 USD (base salary)
AI focus
Build model integration and routing, agent infrastructure, context management, and evaluation systems; integrate advances in AI and agentic systems.
Model-written summary · the original posting is authoritative