JPMorgan Chase
Lead Software Engineer - DataBricks, Spark, Terraform
$138K–$185K
Chicago, IL · Full-time · Posted Sep 8, 2026
- Experience
- 7+ years in data engineering/platform engineering.
About the job
Leads the architecture, engineering, operations, and governance of a Databricks lakehouse platform, while guiding a team’s use of AI-assisted development tools.
What you'll do
- Set platform roadmaps and standards; design curated data layers and optimize Spark/SQL workloads.
- Establish reliability, security, governance, monitoring, and cost-management practices for pipelines and SQL workloads.
- Mentor engineers, lead technical reviews, and promote validated, secure AI-assisted engineering practices.
What they ask for
- 7+ years in data or platform engineering, including hands-on Databricks experience in production.
- Strong Spark (PySpark/Scala) and SQL proficiency, including performance tuning and troubleshooting.
- Experience building and operating data platforms and designing or optimizing data lake tables.
- Experience with governance, software engineering practices, observability, and leading approved AI-assisted development responsibly.
Nice to have
- Databricks Workflows, Delta Live Tables (DLT), Structured Streaming, or Databricks SQL Warehouses; dbt or semantic layer patterns.
- Terraform, automated environment provisioning, or regulated-data and enterprise governance experience.
Pay
$137,750.00-$185,000.00 USD base salary
Tools
Databricks, Spark, PySpark, Scala, SQL, Unity Catalog, Delta Lake, Terraform
AI focus
Uses and leads adoption of AI-assisted coding, code review/refactoring, test acceleration, troubleshooting, analytics, and incident/root-cause support, with validation for correctness, performance, security, and responsible handling of sensitive data.
Model-written summary · the original posting is authoritative