River AI
Software Engineer, River API
$200K–$420K
Palo Alto, CA +1 · Full-time · Posted May 13, 2026
- Location
- Palo Alto, CA
Palo Alto, California, United States - Education
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical industry experience.
- Visa sponsorship
- The company sponsors visas and supports the process for the right candidate.
About the job
Build and optimize distributed systems, GPU kernels, and infrastructure for large-scale model training and inference.
What you'll do
- Architect and deploy fault-tolerant training and inference systems across clusters of thousands of nodes.
- Design high-performance kernels and profile hardware, software, data pipelines, and communication to improve system performance.
- Work with research scientists to implement, optimize, and scale experimental model architectures.
What they ask for
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical industry experience.
- Deep expertise in C, C++, or Rust and a track record of writing performant, maintainable code.
- Strong foundation in computer architecture, memory management, and concurrent programming.
- Exceptional debugging skills, particularly in distributed environments.
Nice to have
- Hands-on experience with PyTorch, JAX, or tooling for large-scale model training.
- Familiarity with modern GPU architectures and experience shipping high-performance distributed systems or low-level libraries.
Pay
$200,000 - $420,000 USD per year (base salary)
Tools
C, C++, Rust, InfiniBand/RDMA, PyTorch, JAX, NVIDIA, AMD
AI focus
Build infrastructure for training and inference, optimize GPU kernels and model-training systems, and help scale experimental model architectures.
Model-written summary · the original posting is authoritative