Peregrine
Staff Software Engineer, Data Infrastructure
$200K–$275K
New York, NY +3 · Staff · Full-time · Posted Mar 12, 2026
- Location
- New York, NY
New York, New York, United States
San Francisco, California, United States
Washington, District of Columbia, United States - Experience
- 8+ years architecting and operating large-scale data infrastructure systems in production environments.
- Education
- Degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
About the job
Architects and operates the large-scale data infrastructure that ingests, stores, processes, and serves real-time operational data.
What you'll do
- Design and operate high-throughput data integration and scalable storage systems.
- Build and optimize distributed data processing pipelines; improve infrastructure performance, reliability, and cost efficiency.
- Define data contracts and integration patterns with other teams, and establish infrastructure best practices.
What they ask for
- Deep expertise in open table formats, particularly Apache Iceberg, including schema evolution, partitioning, compaction, and time travel.
- Extensive hands-on experience with Apache Spark and strong background in real-time integration and stream processing.
- Production experience with Airflow or similar orchestration tools, Python and/or Scala, AWS or comparable cloud platforms, and Kubernetes.
- Located in New York and open to working in office.
Pay
$200,000 — $275,000 USD (annual salary)
Tools
AWS GovCloud, Apache Iceberg, Apache Spark, Apache Kafka, Airflow, Kubernetes, Apache Flink, Python, Scala
Model-written summary · the original posting is authoritative