Software Engineer, Inference Platform

What you'll do

• Design, develop, test, and maintain production software across reliability, security, networking, observability, and operations.
• Shape platform architecture and technical direction, including Kubernetes resources, failure domains, and service boundaries.
• Improve system reliability and performance, and lead production incident response, capacity planning, and post-incident improvements.

What they ask for

• 3+ years of software engineering experience, including building and operating large-scale distributed systems or cloud infrastructure.
• Experience with distributed systems; Kubernetes experience is ideal.
• Experience building highly available, latency-sensitive systems at scale.
• Experience with security (certificates, TLS, mTLS); strong proficiency in Go or C++.

Nice to have

• Experience with TTFT and tail-latency reduction.
• Experience with ML inference infrastructure, model serving systems, or GPU-accelerated workloads.

Tools

Kubernetes, Go, C++, TLS, mTLS

AI focus

Build the inference platform orchestration layer that runs inference on datacenter clusters.