Cohere
Software Engineer, Data Infrastructure
$160K–$325K
New York +5 · Remote · Full-time · Posted May 14, 2026
- Location
- New York
San Francisco
Canada
United States
Toronto
Montreal
About the job
Build and operate a distributed storage and data-movement system that serves model training and evaluation workloads across clusters and regions.
What you'll do
- Design, build, and operate distributed storage for training and evaluation.
- Run the system on Kubernetes clusters at petabyte scale.
- Translate workload needs into throughput, latency, and durability requirements while addressing networking, I/O, and consistency challenges.
What they ask for
- Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management.
- Strong coding ability in Python or Go, with willingness to learn the other.
- Experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets.
- Hands-on experience with cloud object storage such as S3 and POSIX-style filesystems.
Nice to have
- Experience with parallel or HPC filesystems such as Weka, VAST, or Lustre.
- Familiarity with large-scale model training data-loading and checkpointing patterns.
Pay
$160K – $325K (base salary)
Tools
Python, Go, Kubernetes, Persistent Volumes, CSI drivers, StatefulSets, S3, Weka
AI focus
Build storage infrastructure that supports model training and evaluation, including moving training data and model checkpoints.
Model-written summary · the original posting is authoritative