JPMorgan Chase
Lead Software Engineer - Databricks
Plano, TX · Full-time · Posted Sep 3, 2026
- Experience
- 5+ years applied experience; no alternatives stated.
- Education
- Formal training or certification on software engineering concepts.
About the job
Leads architecture, development, performance, security, and operation of scalable Databricks data pipelines and platforms, while guiding engineering practices and approved AI-assisted development across the team.
What you'll do
- Architect and deliver batch and streaming data pipelines and Lakehouse platforms using Databricks, Spark, and Delta Lake.
- Lead cluster configuration, performance and cost optimization, data quality, governance, security, and CI/CD practices.
- Promote responsible, enterprise-authorized AI-assisted engineering and set standards for validating AI-generated work.
What they ask for
- Formal training or certification in software engineering concepts and 5+ years of applied experience.
- Advanced production experience with Apache Spark on Databricks and/or AWS EMR, including Databricks services and Spark performance tuning.
- Experience architecting and operating reliable batch and streaming ETL/ELT pipelines; strong SQL and data modeling skills.
- Proficiency in Python and/or Java, and demonstrated leadership in approved AI-assisted development and responsible, secure engineering.
Nice to have
- Experience with Delta Live Tables, advanced Databricks governance, AWS networking, and Terraform.
- Familiarity with Airflow, Genie, Streamlit, React, data-system observability, or cost optimization.
Tools
Databricks, Apache Spark, Delta Lake, Unity Catalog, AWS Glue Catalog, Python, Java, Terraform
AI focus
Leads adoption of approved AI-assisted engineering for coding, code review and refactoring, test acceleration, troubleshooting, and incident/root-cause analysis; establishes validation standards for correctness, performance, security, and responsible handling of sensitive data.
Model-written summary · the original posting is authoritative