Arm
Principal Software Engineer, AI Compute Platform
$263K–$355K
Seattle, Washington · Principal · Full-time · Posted Sep 9, 2026
- Experience
- 12+ years; no alternatives stated.
- Visa sponsorship
- Relocation package, including visa sponsorship assistance, is offered for candidates who need it.
About the job
Designs and builds a secure, reliable platform and tools for running distributed AI training and inference workloads at scale.
What you'll do
- Build backend services, APIs, asynchronous workflows, and Kubernetes controllers for AI workload management.
- Deliver secure multi-tenant features and improve platform scalability, observability, reliability, and developer workflows.
- Partner with teams to provide distributed training, evaluation, and inference capabilities and strengthen engineering quality.
What they ask for
- 12+ years of experience building distributed systems, cloud platforms, or production backend services.
- Experience with distributed ML training or inference systems.
- Strong programming skills in Go, Python, or similar systems languages.
- Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.
Nice to have
- Experience with Kubernetes operators, schedulers, resource management, or GitOps; knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, and Grafana.
- Familiarity with distributed AI platforms, inference serving, PyTorch, Ray, or vLLM; platform or developer-tools delivery experience; technical leadership, mentoring, or an advanced degree.
Pay
$262,700-$355,400 per year (base salary)
Tools
Go, Python, Kubernetes, PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana
AI focus
Builds platform capabilities for distributed AI training, evaluation, and inference, including workload orchestration and serving.
Model-written summary · the original posting is authoritative