Harvey
Engineering Manager, Model Infrastructure
$260K–$350K
San Francisco · Hybrid · Manager · Full-time · Posted Jul 22, 2026
- Experience
- 8+ years of software engineering experience, including multiple years managing high-performing engineering teams.
About the job
Leads the team building and operating Harvey’s model infrastructure platform, ensuring reliable, scalable, cost-efficient model services and laying groundwork for future in-house model training.
What you'll do
- Lead and develop the Model Infrastructure engineering team and define its technical roadmap.
- Build and operate systems for provider integrations, model provisioning, traffic routing, reliability, observability, and cost optimization.
- Develop infrastructure for future model training and partner with research, product, infrastructure, executives, and external AI providers.
What they ask for
- 8+ years of software engineering experience, including multiple years managing high-performing engineering teams.
- Experience leading teams responsible for large-scale distributed systems or cloud infrastructure.
- Experience operating highly available production services and building scalable, observable, automated, cost-optimized platforms.
- Strong technical, cross-functional leadership, communication, and engineering talent development skills.
Nice to have
- Experience with AI infrastructure, LLM serving, machine learning platforms, inference platforms, or model gateways.
- Experience with Kubernetes, GPU infrastructure, model training platforms, or data technologies such as Spark, Kafka, Flink, Airflow, or Iceberg.
Pay
$260,000 - $350,000 USD (base salary); $260K – $350K (unspecified compensation)
Tools
OpenAI, Anthropic, Azure OpenAI, Fireworks, Baseten, Kubernetes, Spark, Kafka
AI focus
Operates multi-provider AI model infrastructure and builds the platform foundation for Harvey to train, evaluate, deploy, and operate its own frontier AI models.
Model-written summary · the original posting is authoritative