Harvey
Staff Software Engineer, Backend Platform
$231K–$340K
San Francisco +1 · Hybrid · Staff · Full-time · Posted Oct 20, 2026
- Location
- San Francisco
New York - Experience
- 8+ years of software engineering experience (post-BS/MS).
About the job
Build and operate shared backend frameworks, libraries, and platform capabilities that help product teams ship reliable, observable, and performant services.
What you'll do
- Develop internal backend frameworks, libraries, APIs, and service templates that standardize common capabilities and service patterns.
- Improve platform performance, scalability, reliability, and observability, including through asynchronous I/O, streaming, tracing, metrics, and automated tests.
- Partner with model infrastructure, developer experience, infrastructure, and product engineering teams on GenAI application needs and platform adoption.
What they ask for
- 8+ years of software engineering experience (post-BS/MS), including building scalable backend systems or internal developer platforms.
- Proficiency in Python (or similar languages) and deep knowledge of APIs, data stores, concurrency, and distributed systems.
- Hands-on experience with web frameworks and service architectures, and understanding of clean, versioned API design.
- Experience with caching, messaging, and database technologies, plus writing high-quality, well-tested code.
Nice to have
- Experience contributing to or maintaining internal libraries/frameworks.
Pay
$231,000 - $340,000 USD (base salary); $231K – $325K (total pay)
Tools
Python, asyncio, Flask/FastAPI, Redis, Kafka, SQL/NoSQL databases, Vector databases
AI focus
Collaborate on GenAI-native application infrastructure, including high-throughput model inference, streaming and long-running API interactions, and abstractions for retrieval, context handling, and prompt lifecycle.
Model-written summary · the original posting is authoritative