Lead Software Engineer – Market Risk Reporting & Visualization

What you'll do

• Lead scalable PySpark and SQL pipelines, data models, and reporting-ready views for complex market risk data.
• Set engineering patterns and practices for data quality, lineage, testing, deployment, security, and production operations.
• Guide engineers and partners, and advance AI-assisted development and automation with human oversight and validation.

What they ask for

• Expert-level Python and PySpark, strong SQL, and understanding of distributed processing and Spark performance.
• Hands-on experience with a modern lakehouse or cloud data platform, such as Databricks and Delta Lake, and cloud object storage such as Amazon S3.
• Experience designing and operating production data-intensive applications, including technical leadership of complex deliveries.
• Bachelor’s or advanced degree in a related technical discipline, or equivalent practical experience.

Nice to have

• Experience with reporting and visualization tools or frameworks, or datasets for interactive dashboards.
• Experience applying LLMs or agentic techniques to engineering, requirements analysis, data investigation, or reporting workflows.

Pay

$156,750.00-$215,000.00 USD base salary

Tools

Python, PySpark, SQL, Databricks, Delta Lake, Amazon S3, Unity Catalog

AI focus

Use approved AI-assisted development tools and identify AI and automation opportunities in requirements analysis, pipeline development, test generation, data quality investigation, and reporting workflows, with disciplined validation and human oversight.