Peregrine
Staff Software Engineer, Data Infrastructure
$200K–$275K
San Francisco, CA +3 · Staff · Full-time · Posted Mar 12, 2026
- Location
- San Francisco, CA
New York, New York, United States
San Francisco, California, United States
Washington, District of Columbia, United States - Experience
- 8+ years.
- Education
- Degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
About the job
Architect and operate the data infrastructure that ingests, stores, processes, and serves large volumes of real-time operational data.
What you'll do
- Design and operate high-throughput real-time data integration and scalable data storage systems.
- Build and optimize distributed batch and streaming pipelines; improve infrastructure performance, reliability, and cost efficiency.
- Define data contracts and integration patterns with other teams, and establish infrastructure best practices.
What they ask for
- 8+ years of experience architecting and operating large-scale production data infrastructure.
- Deep expertise in open table formats, particularly Apache Iceberg, and extensive hands-on experience with Apache Spark at scale.
- Strong background in real-time integration and stream processing; experience with pipeline orchestration, AWS or comparable cloud platforms, and Kubernetes.
- Strong Python and/or Scala software engineering fundamentals; degree in a related field or equivalent practical experience; located in San Francisco and open to working in office.
Pay
$200,000 — $275,000 USD annual salary
Tools
AWS GovCloud, Apache Iceberg, Apache Spark, Apache Kafka, Airflow, Kubernetes, Apache Flink, Python, Scala
Model-written summary · the original posting is authoritative