Minerva
Data Platform Engineer, Ingestion
$170K–$236K
New York City · On-site · Full-time · Posted Oct 23, 2026
- Experience
- Typically three or more years building and supporting production data pipelines, or equivalent ownership.
About the job
Build and operate dependable ingestion pipelines for customer and vendor data, automate source onboarding, and provide reusable ingestion modules to other teams.
What you'll do
- Build pipelines for APIs, files, database extracts, and approved scraping sources; make incremental loads, backfills, and retries safe.
- Automate source onboarding and build reusable connectors and storage components with testing, monitoring, and clear interfaces.
- Maintain source metadata and privacy controls, monitor integrations in production, and document recovery runbooks.
What they ask for
- Strong Python and SQL.
- Experience bringing in data from many vendors and source types, including messy data at scale, and supporting it after launch.
- Practical judgment about incremental processing, backfills, failures, and cost; ability to demonstrate data correctness as volume grows.
- Located in New York City or willing to relocate.
Nice to have
- Connector frameworks or onboarding automation and self-service data tooling.
- Production experience with Dagster, Iceberg, or Snowflake.
Pay
$170,000–$236,000 base salary
Tools
Dagster, Airflow, dbt, SQLMesh, Snowflake, Spark, Iceberg, Trino
Model-written summary · the original posting is authoritative