Microsoft
Senior and/or Principal Software Engineer - Performance
$120K–$304K
United States · On-site · Principal · Full-time · Posted Oct 2, 2026
- Experience
- 4+ years required; preferred alternatives: 8+ years with a Master's Degree, or 12+ years with a Bachelor's Degree, or equivalent experience.
- Education
- Bachelor's Degree in Computer Science or related technical field, or equivalent experience.
About the job
Develops and optimizes software across the AI stack to improve LLM inference performance and enable rapid, efficient deployment at scale.
What you'll do
- Benchmark and optimize LLM performance on Nvidia/AMD GPUs and Microsoft silicon, and identify end-to-end improvements.
- Build software tools for performance analysis, model porting, and large-scale deployment; design, implement, and test AI framework components.
- Collaborate with internal and external partners to improve system performance and efficiency.
What they ask for
- Bachelor's Degree in Computer Science or related technical field and 4+ years of technical engineering experience coding in a listed language, or equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements, including the Microsoft Cloud Background Check.
Nice to have
- Master's Degree and 8+ years of technical engineering experience, or Bachelor's Degree and 12+ years, or equivalent experience.
- Background in software engineering, computer/GPU architecture, and neural net acceleration; LLM performance optimization and profiling; DNN/LLM inference frameworks and related tools.
Pay
USD $119,800 - $234,700 per year (base salary); USD $160,200 - $261,000 per year (base salary); USD $142,800 - $274,800 per year (base salary); USD $188,000 - $304,200 per year (base salary)
Tools
C, C++, C#, Java, JavaScript, Python, PyTorch, Tensorflow
AI focus
Hands-on performance engineering for LLM inference, including benchmarking, profiling, optimization, tooling, and deployment across GPUs and Microsoft silicon.
Model-written summary · the original posting is authoritative