Microsoft
Principal Software Engineering, AI Infrastructure
$143K–$304K
United States · On-site · Principal · Full-time · Posted Oct 16, 2026
- Experience
- 6+ years; preferred alternatives: 8+ years with a Master's Degree, or 12+ years with a Bachelor's Degree; equivalent experience is also stated.
- Education
- Bachelor's Degree in Computer Science or related technical field, or equivalent experience.
About the job
Build and operate GPU-accelerated cloud infrastructure and services for large-scale AI training and inference, while guiding platform architecture and technical direction.
What you'll do
- Develop AI workload management, scheduling, failover, and serving systems; build GPU infrastructure across bare metal, virtual machines, and containers.
- Build and operate Kubernetes-based orchestration and resource governance, and develop services in C# and Golang.
- Improve GPU fleet performance, reliability, and utilization; lead platform features from design through production and influence architecture across teams.
What they ask for
- Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience coding in listed languages, or equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements, including the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Nice to have
- Master's Degree and 8+ years of technical engineering experience, or Bachelor's Degree and 12+ years, or equivalent experience.
- Experience with production-scale infrastructure, scheduling on large clusters, online inference, multitenant AI platforms, inference or distributed training stacks, GPU computing, or microservices operations.
Pay
USD $142,800 - $274,800 per year (base salary); USD $188,000 - $304,200 per year (base salary)
Tools
C#, Golang, AKS, Kubernetes, CUDA, NCCL
AI focus
Develop and operate GPU infrastructure and workload systems for large-scale AI training and inference, including AI serving and multitenant platforms.
Model-written summary · the original posting is authoritative