Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)

What you'll do

• Own MDT’s end-to-end architecture, including its API, scheduler, Kubernetes workers, storage integration, and network paths.
• Assess and evolve the production prototype, migrating current customers without interruption while improving throughput and reliability.
• Set technical direction, cross-team interfaces, operational standards, and engineering practices; mentor the team and partner with Product.

What they ask for

• 8+ years shipping production software, including leading a service from prototype to general availability.
• Hands-on experience designing and operating data-intensive distributed systems at scale.
• Understanding of object storage semantics, file systems, and TCP throughput, with ability to profile and improve transfer performance.
• Experience evolving live systems with low customer risk, defining API and schema contracts, and owning customer-facing on-call.

Nice to have

• Go proficiency (strongly preferred); otherwise, proficiency in another modern compiled language.
• Experience with bulk data transfer systems, cloud networking/interconnects, cross-account cloud IAM, ANN indexing, or AI/HPC/Physical AI data pipelines.

Pay

USD $215,000 -$260,000 + Bonus (compensation range; base salary or total pay not specified).

Tools

Go, Kubernetes, AWS DataSync, Google Storage Transfer Service, rclone, AWS Direct Connect, GCP Interconnect, HNSW

AI focus

Build data-transfer infrastructure for AI training workloads, including moving petabyte-scale training data to Crusoe GPUs.