ServiceNow
Senior Staff Machine Learning Engineer - DevOps
$201K–$352K
Santa Clara, CALIFORNIA, United States · Hybrid · Senior Staff · Full-time · Posted Oct 14, 2026
- Experience
- 8+ years of backend software engineering; 4+ years designing and operating distributed systems; 3+ years of production Kubernetes. A master’s degree may offset up to one year of the experience minimum.
- Education
- Bachelor’s degree in computer science, software engineering, or a closely related technical field required. Equivalent practical experience is considered where technical depth is clearly demonstrable.
About the job
Leads the architecture, optimization, and operation of ServiceNow’s AI inference platform, from model onboarding to production deployment, and builds its intelligent API gateway.
What you'll do
- Own the end-to-end inference lifecycle and deploy optimized inference engines across multiple backends on Kubernetes.
- Architect the Envoy and ext_proc gateway layer for access control, observability, and request routing.
- Operate production services, including monitoring, incident response, root-cause analysis, and service-level objectives.
What they ask for
- Expertise in Go or Python, object-oriented programming, design patterns, efficient algorithms, and quality software development.
- Knowledge of core AI/ML techniques and algorithms, plus unit testing, profiling, and code tuning.
- 8+ years of backend software engineering experience; 4+ years designing and operating distributed systems; 3+ years of production Kubernetes, including Helm and CI/CD.
- Bachelor’s degree in computer science, software engineering, or a closely related technical field; equivalent practical experience may be considered.
Pay
$201,300 - $352,300 USD base salary
Tools
Go, Python, Kubernetes, Helm, CI/CD, Envoy, ext_proc, GitHub Copilot
AI focus
Builds and operates an AI inference platform, deploying optimized inference engines for models; also uses AI coding assistants and AI-assisted debugging and trace analysis.
Model-written summary · the original posting is authoritative