Qualcomm
Senior/Staff Software Engineer - LLM Inference Systems & Open-Source
$162K–$243K
Santa Clara, California +1 · On-site · Staff · Full-time · Posted Oct 14, 2026
- Location
- Santa Clara, California
San Diego, California - Experience
- Bachelor's degree: 4+ years; master's degree: 3+ years; PhD: 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.
- Education
- Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field, or equivalent practical experience. Minimum qualifications also specify Computer Science, Engineering, Information Systems, or a related field.
About the job
Build and improve open-source LLM inference and serving systems, including their distributed infrastructure and integrations for Qualcomm AI accelerators.
What you'll do
- Contribute features, fixes, and architectural improvements to llm-d and other open-source LLM inference projects, collaborating with upstream communities.
- Develop Qualcomm platform support, including inference runtime integrations, deployment capabilities, and distributed inference features.
- Profile and optimize performance, diagnose cross-stack issues, and collaborate with hardware, firmware, compiler, runtime, Kubernetes, and product teams.
What they ask for
- Strong software engineering and debugging skills.
- Production-quality software development experience in one or more of Python, C++, Go, or Rust.
- Strong understanding of at least one area: machine learning or LLM inference systems, distributed systems, AI accelerator or GPU software, cloud-native/Kubernetes infrastructure, or ML compiler/runtime systems.
- Experience with complex software systems and debugging across multiple layers of the stack.
Nice to have
- Experience with LLM inference engines, model-serving frameworks, distributed inference, llm-d, or cloud-native AI infrastructure.
- Experience with accelerator software, compiler/runtime technologies, distributed communication, performance optimization, Kubernetes operations, or open-source development.
Pay
$162,000.00 - $243,000.00 (salary; base or total pay not specified)
Tools
llm-d, Python, C++, Go, Rust, Kubernetes, KServe, PyTorch
AI focus
Develop and optimize scalable LLM inference and serving software, distributed inference capabilities, and integrations that run inference efficiently on Qualcomm AI accelerators.
Model-written summary · the original posting is authoritative