JPMorgan Chase
SR Principal Software Engineer - LLM Engineering
$204K–$325K
Palo Alto, CA +4 · Principal · Full-time · Posted Aug 24, 2026
- Location
- Palo Alto, CA
Seattle, WA
Chicago, IL
New York, NY
Jersey City, NJ - Experience
- 10+ years of applied experience; 8+ years of AI/ML engineering experience.
- Education
- Formal training or certification on software engineering concepts; preferred Master’s or PhD in Computer Science, Engineering, or a related field (or equivalent experience).
About the job
Leads the architecture, development, deployment, and operation of scalable LLM and GNN serving platforms and AI/ML engineering capabilities.
What you'll do
- Set strategy for model serving, MLOps/LLMOps, inference optimization, and agentic AI-enabled engineering.
- Build reusable ML engineering platforms and productionize, monitor, and operate AI workloads across cloud and on-premises environments.
- Partner across engineering, data science, and SRE teams to deliver secure, reliable, cost-efficient AI capabilities.
What they ask for
- Formal training or certification in software engineering concepts.
- 10+ years of applied experience and 8+ years of AI/ML engineering experience, including significant LLM and GNN expertise.
- Experience architecting and deploying enterprise-scale LLM and GNN solutions on AWS, and building inference engines with Triton Inference Server and vLLM.
- Advanced Python and deep learning framework proficiency; expertise in inference optimization, distributed systems, and LLMOps/MLOps.
Nice to have
- Master’s or PhD in Computer Science, Engineering, or a related field (or equivalent experience).
- Cloud-native experience, AI/ML security and governance, trust and safety or fraud prevention, hardware acceleration, or Java application development.
Pay
USD 232,750.00-$325,000.00 base salary (Palo Alto, CA); USD 232,750.00-$325,000.00 base salary (Seattle, WA); USD 204,250.00-$300,000.00 base salary (Chicago, IL); USD 232,750.00-$325,000.00 base salary (New York, NY); USD 232,750.00-$325,000.00 base salary (Jersey City, NJ)
Tools
LLMs, GNNs, AWS, SageMaker, Bedrock, EKS, Triton Inference Server, vLLM
AI focus
Develops and operates LLM/GNN serving and lifecycle platforms, optimizes inference, and establishes governed agentic AI-enabled engineering practices.
Model-written summary · the original posting is authoritative