Goaly AI
Founding Senior Infra Engineer, Distributed Infra
Palo Alto, CA, USA · Hybrid · Senior · Full-time · Posted Aug 26, 2026
- Visa sponsorship
- The company sponsors visas, but cannot successfully sponsor one for every role and candidate; if it makes an offer, it will make every reasonable effort to secure the necessary visa and provides immigration counsel.
About the job
Owns the infrastructure lifecycle of accelerator clusters, building reliable, secure systems that bring compute capacity online and support AI research workloads.
What you'll do
- Build and operate control-plane services and infrastructure-as-code for provisioning, upgrades, recovery, and cluster decommissioning.
- Coordinate with cloud, datacenter, hardware, networking, and internal teams to bring accelerator capacity online and improve cluster performance and reliability.
- Establish observability and service-level objectives, and lead incident response and postmortems.
What they ask for
- Deep expertise in distributed systems, reliability, and cloud platforms.
- Strong programming ability in Python, Go, Rust, or another language suited to infrastructure services and automation.
- Hands-on experience with Linux, containers, Kubernetes or another cluster scheduler, infrastructure-as-code, and a major cloud platform or substantial bare-metal environment.
- Practical understanding of networking, storage, identity, observability, and reliability, including tracing failures across system layers.
Nice to have
- Experience operating large GPU or accelerator fleets for distributed training, inference, scientific computing, or other communication-intensive workloads.
- Experience with Kubernetes internals, high-performance networking, Terraform, GPU systems, or comparable orchestration and infrastructure technologies.
Tools
Kubernetes, IaC, AWS, GCP, Azure, Python, Go, Rust
AI focus
Builds and operates accelerator-cluster infrastructure that supports AI model training, reinforcement learning, post-training, and inference workloads.
Model-written summary · the original posting is authoritative