Arm
Staff Software Engineer, AI Compute Platform
$209K–$283K
Seattle, Washington · Staff · Full-time · Posted Sep 9, 2026
- Experience
- 8+ years building distributed systems, cloud platforms, or production backend services.
- Education
- An advanced degree or equivalent experience in a related field is listed as a desired qualification.
- Visa sponsorship
- Relocation package, including visa sponsorship assistance, is offered for candidates who need it.
About the job
Build and operate a secure, reliable platform and tools for running distributed AI training and inference workloads at scale.
What you'll do
- Develop backend services, APIs, asynchronous workflows, and Kubernetes controllers for AI workload management.
- Build secure multi-tenant capabilities and improve platform scalability, observability, reliability, and developer workflows.
- Partner across teams to deliver distributed training, evaluation, and inference capabilities.
What they ask for
- Experience with distributed ML training or inference systems.
- Strong programming skills in Go, Python, or similar systems languages.
- Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
- Ability to build clear interfaces and simplify infrastructure; clear communication and collaboration skills.
Nice to have
- Experience with Kubernetes operators, schedulers, resource management, or GitOps; or equivalent experience.
- Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus and Grafana; or familiarity with PyTorch, Ray, or vLLM.
Pay
$209,100-$282,900 per year (USD, base salary)
Tools
Go, Python, Kubernetes, PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana
AI focus
Build platform capabilities for distributed AI training, evaluation, and inference, including workload orchestration and management.
Model-written summary · the original posting is authoritative