Cohere
Staff/Senior Staff Software Engineer, Agent Infrastructure
$240K–$360K
Toronto +2 · Remote · Senior Staff · Full-time · Posted Oct 22, 2026
- Location
- Toronto
Canada
United States
About the job
Build and productionize infrastructure for autonomous AI agents, spanning secure execution, orchestration, identity, and state management.
What you'll do
- Turn emerging ML research ideas into production-ready infrastructure and build platform capabilities for execution, storage, and state management.
- Prototype and evaluate technologies, deciding what should move into production.
- Partner with research teams to shape infrastructure for future agent systems.
What they ask for
- Experience building production ML infrastructure with strong systems fundamentals.
- Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks.
- Familiarity with model routing and LLM provider frameworks across different model types and environments.
- Experience with scalable, fault-tolerant distributed systems and Kubernetes.
Nice to have
- Experience with code execution sandboxes such as gVisor, Firecracker, Kata, or WASM runtimes.
- Experience across on-prem, private cloud, and public cloud environments.
Pay
$240K – $360K USD base salary
Tools
Kubernetes, gVisor, Firecracker, Kata, WASM
AI focus
Build infrastructure for autonomous AI agents, including secure code execution, model routing and orchestration, agent workflows, and state management; translate ML research into production systems.
Model-written summary · the original posting is authoritative