Cloudflare
Senior Systems Engineer, AI Gateway
$185K–$266K
In-Office +3 · Senior · Full-time · Posted Jul 22, 2026
- Location
- In-Office
Austin, TX, United States
New York, New York, United States
San Francisco, CA, United States - Experience
- 5+ years building and operating production systems.
- Visa sponsorship
- Offers may be conditioned on authorization to receive software or technology controlled under U.S. export laws without sponsorship for an export license.
About the job
Build and operate AI Gateway infrastructure and developer-facing features for routing high-volume inference traffic across providers, models, and Cloudflare’s global network.
What you'll do
- Develop APIs, routing, observability, controls, and workflows to improve reliability and adoption.
- Improve performance, cost efficiency, and debuggability for latency-sensitive AI workloads; build supporting agents, tests, and operational tools.
- Collaborate across product and infrastructure teams, ship production improvements, and mentor engineers.
What they ask for
- Strong systems engineering fundamentals and experience designing or scaling distributed systems.
- Ability to work across APIs, product surfaces, and backend or infrastructure systems.
- Strong technical communication, developer-tools judgment, and operational judgment.
- Comfort using AI-native development workflows.
Nice to have
- Experience with AI/ML infrastructure, inference platforms, model gateways, or LLM applications.
- Experience with developer-facing platforms or proxy, edge, gateway, routing, or traffic-management systems.
Pay
$194,000 - $266,000 USD annual base salary (Bay Area); $185,000 - $254,000 USD annual base salary (New York City, New Jersey, Washington, Washington DC, and California excluding Bay Area)
Tools
AI Gateway, Workers AI, TypeScript, Go, Rust
AI focus
Build infrastructure for AI inference across providers and models, including routing, reliability, observability, cost controls, and developer workflows; use AI-native tools and agents to accelerate engineering.
Model-written summary · the original posting is authoritative