Principal Data Engineering Lead - Services Special Project

What you'll do

• Build and operate reliable ETL/ELT pipelines and Kafka-based ingestion for diverse and real-time data.
• Define data models, quality, observability, governance, and security practices across the data platform.
• Partner with ML, data science, platform, and leadership teams on scalable solutions and cross-Apple initiatives.

What they ask for

• Master’s degree.
• 12+ years of data engineering experience, including building and maintaining large-scale ETL/ELT pipelines.
• Proficiency in data modeling, especially dimensional modeling, and experience with SQL/NoSQL databases.
• Experience with distributed data processing and hands-on experience with Apache Kafka, Iceberg, and Flink.

Nice to have

• Experience with data versioning tools such as DVC or Delta Lake.
• Experience storing or serving embeddings with tools such as pgvector, Milvus, or FAISS.

Pay

$262,500 to $394,000 USD base salary

Tools

Apache Spark, BigTable/Hadoop, Scala, Java, Apache Kafka, Iceberg, Flink, Apache Airflow

AI focus

Builds multimodal data pipelines that integrate ML inference, including LLMs and embedding models, for data enrichment and transformation; deploys and optimizes production inference, including low-latency, high-throughput serving.