JPMorgan Chase
Lead Software Engineer - Databricks
Wilmington, DE · Full-time · Posted Jul 8, 2026
- Experience
- 5+ years applied experience; production delivery experience with Apache Spark on Databricks and/or AWS EMR.
- Education
- Formal training or certification on software engineering concepts.
About the job
Leads the architecture, development, and operation of secure, scalable Databricks data pipelines and platforms, while guiding engineering practices and responsible use of approved AI-assisted development tools.
What you'll do
- Architect and tune batch and streaming data pipelines and Lakehouse platforms using Databricks, Apache Spark, and Delta Lake.
- Lead data quality, governance, security, testing, and CI/CD practices across data projects.
- Guide team adoption of approved AI-assisted engineering tools, with validation standards for correctness, performance, and security.
What they ask for
- Formal training or certification in software engineering concepts and 5+ years of applied experience.
- Production experience with Apache Spark on Databricks and/or AWS EMR, including Databricks platform expertise.
- Experience architecting and operating reliable batch and streaming ETL/ELT pipelines; strong Spark performance tuning skills.
- Proficiency in Python and/or Java and SQL, with analytics data modeling expertise.
Nice to have
- Experience with Delta Live Tables and advanced Databricks governance.
- AWS networking, Terraform, cost optimization, or familiarity with Airflow, Genie, Streamlit, and React.
Tools
Databricks, Apache Spark, Delta Lake, Unity Catalog, AWS Glue Catalog, Python, Java, Terraform
AI focus
Leads team use of approved AI-assisted engineering tools for coding, code review/refactoring, testing, troubleshooting, and incident analysis, with validation for correctness, performance, and security.
Model-written summary · the original posting is authoritative