Harvey
Senior Software Engineer, AI Platform
$193K–$290K
New York · Hybrid · Senior · Full-time · Posted Jul 16, 2026
- Experience
- 6+ years building backend systems, including at least 1+ year focused on AI/ML engineering. Staff candidates typically have 8+ years and a track record of technical leadership across teams.
About the job
Build shared AI platform infrastructure, including agent systems, model routing, context management, and evaluation tools used across Harvey’s products.
What you'll do
- Design platform abstractions and systems for Harvey’s agentic products.
- Build infrastructure for model integration, routing, and evaluation.
- Partner with product teams to launch AI products and integrate emerging AI and agentic technologies.
What they ask for
- Experience building and shipping multi-model or multi-provider AI systems in production.
- Familiarity with context management, session state, or memory systems.
- Track record building internal platforms, SDKs, or shared infrastructure adopted by other engineering teams.
- Strong judgment in designing abstractions and a pragmatic, ownership-oriented approach to shipping.
Nice to have
- Experience with evaluation frameworks or agent/function-calling architectures.
- Familiarity with legal or other high-stakes professional services domains, or experience at early-stage or hyper-growth startups.
Pay
$193,400 - $290,000 USD (base salary)
Tools
AI/ML, SDKs
AI focus
Build and evaluate agentic AI platform infrastructure, integrate and route foundation models, manage context and memory, and improve AI quality.
Model-written summary · the original posting is authoritative