Thinking Machines Lab
Software Engineer, Infrastructure
$300K–$400K
San Francisco +1 · On-site · Full-time · Posted Oct 1, 2026
- Location
- San Francisco
New York - Visa sponsorship
- Visa sponsorship is available; success is not guaranteed.
About the job
Designs and operates distributed infrastructure for large-scale model training and inference, including the systems behind Inkling and Tinker.
What you'll do
- Build and operate distributed systems for training and inference across thousands of accelerators.
- Develop and maintain orchestration, scheduling, storage, and resource-management infrastructure.
- Improve infrastructure reliability, performance, and observability; debug distributed failures and maintain internal libraries and APIs.
What they ask for
- Demonstrated expertise designing and developing large-scale distributed systems.
- Strong proficiency in Python and Go.
- Experience building, deploying, and operating production infrastructure at scale.
- Solid grounding in distributed systems fundamentals, including consensus, consistency, fault tolerance, and networking.
Nice to have
- Experience with ML infrastructure or operating large-scale GPU or TPU clusters.
- Experience with container orchestration (e.g. Kubernetes), infrastructure-as-code, or open-source infrastructure contributions.
Pay
$300,000 - $400,000 USD (base salary)
Tools
Python, Go, Kubernetes, GPU, TPU
AI focus
Builds infrastructure that supports frontier model training and inference.
Model-written summary · the original posting is authoritative