Principal Software Engineer- AI Frameworks

What you'll do

• Set technical vision and architecture for AI framework, performance, benchmarking, and developer-productivity capabilities.
• Lead cross-stack investigations and deliver measurable improvements in model onboarding, runtime performance, reliability, hardware utilization, and Azure capacity efficiency.
• Provide hands-on technical leadership through implementation, reviews, debugging, operational readiness, and mentoring.

What they ask for

• Bachelor’s Degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Nice to have

• Expertise in GPU or equivalent accelerator programming, compilation, and low-level execution.
• Expertise in LLM parallelism, distributed inference acceleration, or serving architectures such as vLLM and SGLang; cross-team technical leadership and mentoring experience are also noted.

Pay

USD $142,800 - $274,800 per year (base salary); USD $188,000 - $304,200 per year (base salary)

Tools

C++, Python, NVIDIA, AMD GPUs, Microsoft silicon, Azure, vLLM, SGLang

AI focus

Builds and optimizes AI frameworks, model performance, benchmarking, and tooling; the role spans AI model execution, GPU/accelerator programming, LLM training and inference, and AI-assisted development practices.