Senior and/or Principal Software Engineer- AI GPU Performance

What you'll do

• Develop, profile, and optimize GPU kernels, runtime components, and distributed serving systems for latency, throughput, and hardware efficiency.
• Integrate performance optimizations into production and create reusable capabilities across models and hardware.
• Collaborate across engineering, research, infrastructure, compiler, and hardware teams; contribute to reviews, mentoring, and engineering standards.

What they ask for

• Bachelor’s Degree in Computer Science or a related technical field, and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements, including the Microsoft Cloud Background Check.

Nice to have

• Expertise in GPU or equivalent accelerator programming and kernel optimization.
• Familiarity with vLLM, SGLang, or equivalent LLM inference libraries; principal-level preferences also include GPU compilation, LLM parallelism, reusable platforms, and technical leadership.

Pay

USD $142,800 - $274,800 per year (base salary); USD $188,000 - $304,200 per year (base salary); USD $119,800 - $234,700 per year (base salary); USD $160,200 - $261,000 per year (base salary)

Tools

C++, Python, NVIDIA, AMD GPUs, vLLM, SGLang

AI focus

Optimize GPU kernels and distributed inference for LLM serving; use AI-assisted development tools to accelerate development and validate their output.