Lila Sciences
Senior Director, Data Platform Engineering
$260K–$390K
San Francisco, CA USA +1 · Director · Full-time · Posted Apr 1, 2026
- Location
- San Francisco, CA USA
San Francisco, CA - Experience
- 12+ years of software development experience, with a focus on data processing at scale; 5+ years leading senior engineers.
- Education
- BS, MS, or Ph.D. in Computer Science or a related field of study.
About the job
Leads the engineering team and technical strategy for Lila’s data platform, delivering scalable infrastructure for scientific, AI/ML, and product data workloads.
What you'll do
- Build and manage a team of 30–40 data engineers; set priorities, mentor staff, and support their development.
- Own the data platform roadmap, architecture, delivery, reliability, security, and performance.
- Partner with scientists and product and engineering teams to deliver data services, including agentic and low-code interfaces for exploration, analytics, and ML/inference.
What they ask for
- 12+ years of software development experience focused on data processing at scale, including 5+ years leading senior engineers.
- Experience building on AWS/GCP primitives such as S3 + Athena/BigQuery and query engines; operating petabyte-scale platforms with sub-second query latency.
- Experience managing data infrastructure supporting 100+ concurrent ML training and inference workloads; familiarity with LLM/AI-native data patterns.
- Hands-on Python coding and modern backend frameworks; infrastructure-as-code and Kubernetes experience; BS, MS, or Ph.D. in Computer Science or a related field.
Nice to have
- Community thought leadership through conference presentations or blog posts; experience growing teams focused on open-source technologies.
- Scientific data management and quality experience; experience building self-service data products with developer experience as a priority.
Pay
$260,000 — $390,000 USD (base salary)
Tools
AWS, GCP, S3, Athena, BigQuery, Python, Kubernetes, Kafka
AI focus
Supports AI/ML workloads, including concurrent model training and inference; requires familiarity with LLM/AI-native data patterns such as vector stores, embedding pipelines, and pre/mid/post training; drives agentic and low-code data interfaces for ML/inference.
Model-written summary · the original posting is authoritative