d-Matrix
Principal System Software Engineer, AI Inference Execution
$195K–$285K
Santa Clara · Hybrid · Principal · Full-time · Posted Jul 28, 2026
- Experience
- 12+ years with a BS, or 6+ years with an MS.
- Education
- BS in Computer Science, Engineering, Math, Physics, or related degree; MS in these fields preferred. MS or PhD in Computer Science, Electrical Engineering, or related fields preferred.
About the job
Develop and maintain AI deployment software for d-Matrix’s compute engine, building deployment infrastructure and collaborating across software, ML, compiler, and hardware teams.
What you'll do
- Productize and maintain the next-generation AI deployment software stack.
- Build and scale deployment infrastructure and software deliverables within tight development timelines.
- Work across the toolchain to optimize hardware-software co-design with software, ML, compiler, and hardware teams.
What they ask for
- BS in Computer Science, Engineering, Math, Physics, or a related degree with 12+ years of industry software development experience; alternatively, an MS in one of these fields with 6+ years.
- Strong grasp of system software, data structures, computer architecture, and machine learning fundamentals.
- Proficiency in C/C++/Python development in a Linux environment using standard development tools.
- Experience designing and implementing distributed, high-performance software.
Nice to have
- MS or PhD in Computer Science, Electrical Engineering, or related fields.
- Experience with inference servers or model-serving frameworks, deep learning frameworks or runtimes, distributed systems collectives, ML workload deployment, or MLOps tools.
Pay
USD $195K – $285K base salary
Tools
C/C++, Python, Linux, TensorRT-LLM, vLLM, SGLang, PyTorch, TensorFlow
AI focus
Build deployment software and infrastructure for AI inference workloads; experience with serving and deploying ML workloads is relevant.
Model-written summary · the original posting is authoritative