People Culture Talent
Software Engineer, Platform
$200K–$350K
San Francisco, CA · Full-time · Posted Sep 16, 2026
- Experience
- 5+ years; Senior candidates should have a track record of end-to-end ownership and delivery; Staff candidates should have extensive backend/platform experience and hands-on technical leadership.
- Visa sponsorship
- Visa sponsorship available
About the job
Build and scale backend infrastructure for an AI gateway and contribute to related evaluation and leaderboard products.
What you'll do
- Develop reliable, independently scalable gateway services, including streaming responses, recovery, and response normalization.
- Build platform capabilities such as authentication, rate limiting, usage metering, cost tracking, and observability.
- Integrate the gateway with the evaluation platform and collaborate across research, product, and backend teams.
What they ask for
- 5+ years of professional software engineering experience focused on backend services, distributed systems, or developer-facing platforms.
- Strong Golang experience and experience building and operating production backend systems.
- Experience designing reliable APIs, service integrations, or gateway/proxy-style systems.
- Able to work from the San Francisco office five days per week.
Nice to have
- API gateway, proxy, multi-provider integration, streaming API, or resilient distributed systems experience.
- Exposure to LLM APIs, model serving, AI infrastructure, evaluation platforms, or the listed cloud and infrastructure technologies.
Pay
$200k – $350k USD base salary
Tools
Golang, GCP, AWS, Azure, Kubernetes, Terraform, Postgres, Redis
AI focus
Build AI gateway and evaluation-platform capabilities, including integrations with model providers and evaluation data.
Model-written summary · the original posting is authoritative