Harvey
Engineering Manager, AI Platform
$272K–$355K
San Francisco · Manager · Full-time · Posted Oct 20, 2026
- Experience
- 2+ years in a tech-lead/software engineering management role leading ML/AI engineering teams; 5+ years as a backend, infrastructure, or ML/AI engineer.
About the job
Leads the engineering team building shared AI platform systems that improve Harvey’s AI product quality, speed, cost efficiency, and reliability.
What you'll do
- Lead and grow engineers building core AI platform infrastructure; set its roadmap and technical direction.
- Build shared systems for model serving and routing, evaluations and simulations, and document processing, retrieval, search, and citations.
- Partner across Product, Research, Agent Platform, and engineering teams to deliver reusable platform capabilities and reliable, cost-effective AI systems.
What they ask for
- 2+ years in a tech-lead or software engineering management role leading ML/AI engineering teams.
- 5+ years as a backend, infrastructure, or ML/AI engineer.
- Experience building production systems powered by LLMs and internal platforms or shared services used by other engineering teams.
- Strong backend engineering skills, familiarity with distributed systems, and sound judgment balancing AI quality, latency, cost, and delivery speed.
Nice to have
- Experience with open-source model inference and serving, large-scale document processing, search and retrieval, LLM observability and evaluation tooling, or foundation model providers.
- Experience in high-growth environments.
Pay
$272,000 - $355,000 USD (base salary)
Tools
LLMs, OCR, embeddings
AI focus
Builds and leads shared AI infrastructure, including model routing and serving, evaluation and simulation, and document processing, retrieval, search, and citation systems.
Model-written summary · the original posting is authoritative