Harvey
Staff Software Engineer, Production Engineering
$231K–$340K
New York · Hybrid · Staff · Full-time · Posted Jul 30, 2026
- Experience
- 10+ years
About the job
Build and operate Harvey’s production infrastructure, including compute, networking, Kubernetes, and workflow orchestration, to support reliable and scalable products and AI workloads.
What you'll do
- Set technical direction and lead cross-functional infrastructure initiatives focused on reliability, security, scalability, and cost efficiency.
- Operate and improve compute, network, and Kubernetes infrastructure, including capacity planning, automation, observability, and production operations.
- Build secure infrastructure foundations and reusable tooling; participate in on-call and incident response, and mentor engineers.
What they ask for
- 10+ years of software, infrastructure, site reliability, or production engineering experience.
- Deep experience operating large-scale cloud infrastructure on AWS, Azure, or Google Cloud Platform, and Kubernetes in production.
- Experience with distributed systems, infrastructure automation/IaC using Terraform or Pulumi, and production observability and operations.
- Strong knowledge of compute, networking, capacity planning, infrastructure security, and ability to lead cross-functional initiatives.
Nice to have
- Experience supporting AI/ML or LLM infrastructure at scale, or operating GPU fleets and high-performance compute.
- Experience with multi-cloud or hybrid cloud environments, internal platforms, or developer tooling.
Pay
$231,000 - $340,000 USD (base salary); $231K – $340K (base salary)
Tools
AWS, Azure, Google Cloud Platform, Kubernetes, Terraform, Pulumi
AI focus
Build and operate infrastructure supporting AI workloads; AI/ML or LLM infrastructure experience is a plus.
Model-written summary · the original posting is authoritative