Robinhood
Senior Software Engineer, AI Infra
$153K–$230K
Menlo Park, CA +1 · Senior · Full-time · Posted Sep 19, 2026
- Location
- Menlo Park, CA
Bellevue, WA
About the job
Build and operate infrastructure for Robinhood’s machine learning and AI systems, including distributed workloads, GPU scheduling, model serving, and the company’s LLM gateway.
What you'll do
- Design, scale, and operate ML/AI infrastructure, including feature stores, training pipelines, model serving, inference, and observability.
- Improve distributed-system performance and GPU efficiency, and develop scheduling solutions for training and inference.
- Evolve the LLM gateway with intelligent routing and context optimization; monitor and support production infrastructure, including on-call.
What they ask for
- Strong software engineering experience focused on infrastructure, distributed systems, or large-scale backend platforms.
- Experience designing, building, and operating distributed systems in production, with understanding of scalability, reliability, and performance.
- Experience addressing infrastructure challenges such as latency, resource utilization, and production reliability.
- Strong software development and system design skills, including ownership of technical problems from design through production.
Nice to have
- Experience with ML infrastructure, model training or serving, GPU workload scheduling, LLM gateways, or open-source infrastructure technologies.
Pay
$196,000 — $230,000 USD base salary; $172,000 — $202,000 USD base salary; $153,000 — $179,000 USD base salary
AI focus
Build infrastructure for the ML/AI lifecycle, improve GPU utilization and model serving, and develop LLM gateway features such as intelligent model routing, prompt understanding, and context optimization.
Model-written summary · the original posting is authoritative