Build AI
Lead Engineer, ML Data Infrastructure & Systems
$220K–$350K
San Francisco · On-site · Full-time · Posted Aug 30, 2026
- Experience
- No number of years specified; requires production data-path ownership at real scale.
About the job
Leads an end-to-end platform that captures, uploads, stores, packages, and delivers physical-labor video as training-ready datasets to research customers.
What you'll do
- Own the data path from on-device capture and unreliable-network uploads through object storage and training-ready shards.
- Optimize compression, codecs, storage tiers, dataset packaging, versioning, and customer delivery for petabyte-scale media.
- Work with firmware teams on a consistent ingest contract and make platform health, cost, and drop rates visible.
What they ask for
- Experience owning a production media or sensor data path at real scale, such as petabyte-scale object storage, video codecs and compression, unreliable-network uploads, or training-shard/dataset formats.
- Strong software engineering skills, including Python and at least one systems language.
- Linux.
- Measure cost and throughput.
Nice to have
- Experience with pose, multi-camera data, or other large media.
- Experience with AWS or GCP, Kubernetes, Airflow, Temporal, IaC, dataset management or annotation tooling, or external dataset delivery.
Pay
$220K – $350K (base salary)
Tools
Python, Linux, AWS, GCP, Kubernetes, Airflow, Temporal, IaC
AI focus
Builds and delivers training-ready physical-labor video datasets for model training and research customers.
Model-written summary · the original posting is authoritative