fal.ai
Software Engineer, Distributed Systems
$180K–$250K
San Francisco · Full-time · Posted Jul 21, 2025
- Experience
- 3+ years building and operating large-scale production systems.
About the job
Build and operate distributed systems for fal’s AI inference and large-scale GPU computing platform, focusing on reliable, low-latency execution at global scale.
What you'll do
- Own Rust/Python systems powering inference and GPU computing; design for major workload and capacity growth.
- Specialize in platform areas such as global routing, orchestration, autoscaling, GPU fleet automation, storage, networking, or workload execution.
- Use AI to accelerate development and automate operations, alerting, and recovery.
What they ask for
- 3+ years building and operating large-scale production systems with a track record of reliability and scale.
- Strong Rust and/or Python skills.
- Strong systems fundamentals relevant to the specialization, such as distributed coordination, scheduling, fault tolerance, Linux, networking, storage, or capacity management.
- Experience using observability to guide performance and reliability decisions.
Nice to have
- Experience with multi-tenant compute platforms, AI inference or training infrastructure, or GPU workload scheduling.
- Experience with GPU infrastructure, distributed filesystems, Linux fleet automation, or global networking technologies.
Pay
$180K – $250K USD base salary
Tools
Rust, Python, Linux, JuiceFS, Lustre, DCGM, NVLink, RDMA
AI focus
Develop and operate AI inference infrastructure; use AI to accelerate software development and automate repetitive operations, alerting, and recovery.
Model-written summary · the original posting is authoritative