Handshake
Senior Software Engineer, Data Platform
$200K–$260K
San Francisco, CA · On-site · Senior · Full-time · Posted Sep 28, 2026
About the job
Leads the design and operation of Handshake’s data platform, building reliable orchestration, ingestion, streaming, and warehouse infrastructure for marketplace, analytics, ML, and AI workloads.
What you'll do
- Set technical direction and operate the Airflow and Astronomer platform, including deployments, capacity, monitoring, upgrades, and incident response.
- Build and improve batch, streaming, and change data capture pipelines, workflow tooling, and cloud infrastructure.
- Lead cross-team platform decisions, mentor engineers, and strengthen reliability and data foundations for AI workloads.
What they ask for
- Strong Python software engineering skills and experience operating production data or distributed systems.
- Deep hands-on Airflow experience, including deployment, scaling, monitoring, upgrades, and debugging.
- Experience with streaming infrastructure, message brokers or managed event buses, and stream processing systems.
- Experience with cloud infrastructure and infrastructure as code, plus a track record leading infrastructure initiatives across teams.
Nice to have
- GCP services such as Pub/Sub, Dataflow, Datastream, BigQuery, GKE, and Cloud Storage.
- Astronomer, Apache Beam, Terraform, Spacelift, Datadog, dbt, Spark or Dataproc.
Pay
$200K – $260K USD base salary
Tools
Python, Airflow, Astronomer, Pub/Sub, Dataflow, Beam, Datastream, BigQuery
AI focus
Build data and orchestration foundations for AI workloads, including batch inference, evaluation datasets, and agent-facing data.
Model-written summary · the original posting is authoritative