Drimva

Lila Sciences

Senior Director, Data Platform Engineering

$260K–$390K

San Francisco, CA USA +1 · Director · Full-time · Posted Apr 1, 2026

Location
San Francisco, CA USA
San Francisco, CA
Experience
12+ years of software development experience, with a focus on data processing at scale; 5+ years leading senior engineers.
Education
BS, MS, or Ph.D. in Computer Science or a related field of study.

About the job

Leads the engineering team and technical strategy for Lila’s data platform, delivering scalable infrastructure for scientific, AI/ML, and product data workloads.

What you'll do

  • Build and manage a team of 30–40 data engineers; set priorities, mentor staff, and support their development.
  • Own the data platform roadmap, architecture, delivery, reliability, security, and performance.
  • Partner with scientists and product and engineering teams to deliver data services, including agentic and low-code interfaces for exploration, analytics, and ML/inference.

What they ask for

  • 12+ years of software development experience focused on data processing at scale, including 5+ years leading senior engineers.
  • Experience building on AWS/GCP primitives such as S3 + Athena/BigQuery and query engines; operating petabyte-scale platforms with sub-second query latency.
  • Experience managing data infrastructure supporting 100+ concurrent ML training and inference workloads; familiarity with LLM/AI-native data patterns.
  • Hands-on Python coding and modern backend frameworks; infrastructure-as-code and Kubernetes experience; BS, MS, or Ph.D. in Computer Science or a related field.

Nice to have

  • Community thought leadership through conference presentations or blog posts; experience growing teams focused on open-source technologies.
  • Scientific data management and quality experience; experience building self-service data products with developer experience as a priority.

Pay

$260,000 — $390,000 USD (base salary)

Tools

AWS, GCP, S3, Athena, BigQuery, Python, Kubernetes, Kafka

AI focus

Supports AI/ML workloads, including concurrent model training and inference; requires familiarity with LLM/AI-native data patterns such as vector stores, embedding pipelines, and pre/mid/post training; drives agentic and low-code data interfaces for ML/inference.

Model-written summary · the original posting is authoritative

First seen Oct 10, 2026 · Last verified Nov 5, 2026 (UTC)