Model Operations Lead, AI Gateway

What you'll do

• Hire, develop, and lead the team while remaining hands-on with code and operational work.
• Manage end-to-end model launches and catalog reliability, including integrations, testing, pricing, security, documentation, and health monitoring.
• Build evals, capability maps, rankings, and automated routing; improve operational scale through tools and agent workflows.

What they ask for

• Experience hiring, managing, and growing engineers or operators.
• Track record delivering technical launches or integrations from ambiguity to production across teams and partners.
• Hands-on ability to write TypeScript, Python, or Rust, read API docs, inspect endpoints, and debug with terminal tools such as logs and cURL.
• Deep familiarity with models, labs, inference providers, and model behaviors such as streaming, tool calling, structured outputs, rate limits, and token pricing.

Nice to have

• Experience at an inference provider, model lab, model router, eval platform, or API company; or background in evals, ranking/recommendation systems, observability, metering, or usage-based billing.
• Familiarity with Cloudflare Workers, AI Gateway, Workers AI, or Replicate.

Pay

$230,000 - $317,000 USD annual base salary (Bay Area based hires); $275,000 - $303,000 USD annual base salary (New York City, New Jersey, Washington, Washington DC, and California (excluding Bay Area) based hires)

Tools

TypeScript, Python, Rust, cURL, Cloudflare Workers, AI Gateway, Workers AI, Replicate

AI focus

Oversees AI model operations and develops model evaluations, capability maps, task rankings, recommendations, and auto-routing based on Gateway traffic, quality, reliability, and cost.