Senior Software Engineer- AI Frameworks

What you'll do

• Design, implement, test, and operate components across AI frameworks, runtimes, benchmarking, performance tooling, and service integrations.
• Benchmark, profile, debug, and optimize LLM training and inference workloads across GPUs and Microsoft hardware.
• Build automation and observability, and deliver scoped engineering projects in collaboration with research, model, infrastructure, and hardware teams.

What they ask for

• Bachelor’s Degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C++, or Python, or equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Nice to have

• Expertise in accelerator programming and kernel optimization using CUDA, Triton, or comparable technologies; performance profiling and benchmarking experience.
• Familiarity with vLLM, SGLang, or equivalent inference frameworks; demonstrated technical ownership and cross-team collaboration.

Pay

USD $119,800 - $234,700 per year (base salary); USD $160,200 - $261,000 per year (base salary)

Tools

C++, Python, CUDA, Triton, vLLM, SGLang, NVIDIA, AMD

AI focus

AI systems engineering focused on LLM training and inference performance, benchmarking, automation, observability, and hardware onboarding; preferred qualification includes effective use of AI-assisted development tools.