Raydar
Senior Software Engineer, Infrastructure
$200K–$280K
New York, New York · Senior · Full-time · Posted Oct 12, 2026
About the job
Own and extend a platform for dispatching, testing, and integrating many concurrent, stateful workloads for AI systems.
What you'll do
- Scale workload dispatch, including queueing, concurrency control, and failure handling.
- Design realistic test environments and evaluation approaches to measure system limits.
- Extend the platform with new environment types and integrations with external orchestration frameworks.
What they ask for
- Track record designing, launching, and growing production backend systems handling heavy traffic and large data volumes.
- Background at a fast-growing startup or fast-paced large technology company.
- Comfort with cluster management tooling and event-driven system design.
- Experience maintaining distributed services and infrastructure for large language model workloads.
Nice to have
- Experience running AI or machine learning workloads at scale.
- Experience at both an early-stage startup and a large technology company; extensive hands-on Kubernetes experience.
Pay
USD 200,000 to 280,000 per year (base salary)
Tools
Kubernetes
AI focus
Build and operate infrastructure for AI and large language model workloads, including evaluation approaches and integrations.
Model-written summary · the original posting is authoritative