Cloudflare
Senior Systems Engineer, Workers AI
$185K–$266K
In-Office +4 · Senior · Full-time · Posted Apr 1, 2026
- Location
- In-Office
Austin, TX, United States
London, United Kingdom
New York, New York, United States
San Francisco, CA, United States - Visa sponsorship
- An offer may be conditioned on authorization to receive software or technology controlled under U.S. export laws without sponsorship for an export license.
About the job
Designs and operates Cloudflare’s global serverless AI inference infrastructure, improving model scheduling, latency, reliability, and observability.
What you'll do
- Develop and maintain highly available, scalable inference platform components; optimize scheduling and request routing.
- Improve platform reliability and observability, including metrics, logging, tracing, and alerts.
- Lead cross-functional projects from design through deployment and mentor junior engineers.
What they ask for
- Proven systems engineering experience focused on distributed, high-performance systems.
- Expert proficiency in Rust, particularly in asynchronous environments.
- Hands-on experience with networking and application protocols such as TCP, HTTP, and WebSocket.
- Experience scaling and optimizing performance, including load balancing and caching in distributed environments.
Nice to have
- Experience with Kubernetes and/or Nomad.
- Familiarity with large-scale inference serving challenges, including LLMs and diffusion models.
Pay
$194,000 - $266,000 USD base salary; $185,000 - $254,000 USD base salary
Tools
Rust, TCP, HTTP, WebSocket, Kubernetes, Nomad
AI focus
Build and optimize global AI inference infrastructure serving real-time voice, open LLMs, and customer-deployed models across GPUs and next-generation accelerators.
Model-written summary · the original posting is authoritative