Gimlet Labs
Member of Technical Staff - Distributed Systems
$150K–$390K
San Francisco, CA · On-site · Staff · Full-time · Posted Mar 10, 2026
- Experience
- No years specified.
- Education
- Bachelor’s degree in a relevant field or equivalent practical experience.
About the job
Builds systems that schedule, route, coordinate, and operate AI inference workloads across Gimlet’s heterogeneous compute infrastructure.
What you'll do
- Build scheduling and orchestration systems for heterogeneous compute and distributed inference pipelines.
- Improve production AI infrastructure reliability, fault tolerance, resource management, and scaling across hardware, nodes, and data centers.
- Develop control planes and APIs for deploying and managing workloads.
What they ask for
- Experience building or operating distributed systems in production.
- Strong software-engineering and systems fundamentals; ability to reason about concurrency, consistency, failure modes, and system tradeoffs.
- Experience with scheduling, resource management, RPC, or asynchronous messaging.
- Bachelor’s degree in a relevant field or equivalent practical experience.
Nice to have
- Experience with Kubernetes or Kubernetes-adjacent systems beyond basic usage.
- Experience designing service-oriented architectures, building reliable APIs, or operating high-load systems; familiarity with scheduling, queues, or resource management systems.
Pay
$150K – $390K (base salary)
Tools
Kubernetes, RPC, Go, C++, Python
AI focus
Builds distributed systems for scheduling, routing, coordinating, and reliably operating AI inference workloads across different hardware.
Model-written summary · the original posting is authoritative