JPMorgan Chase
Software Engineer III- AI, LLM & Data Platforms
Plano, TX · Full-time · Posted Oct 21, 2026
- Experience
- 3+ years of applied experience.
- Education
- Formal training or certification on software engineering concepts.
About the job
Builds and operates production platforms and reusable services for LLM-powered agents, including their evaluation, monitoring, security, and responsible adoption across engineering teams.
What you'll do
- Deliver agent-based AI platform features from design through deployment, monitoring, and improvement.
- Build reusable LLM services and implement evaluation, observability, security, and governance capabilities.
- Promote validated AI-assisted engineering practices and collaborate with stakeholders to deliver measurable outcomes.
What they ask for
- Formal training or certification in software engineering concepts and 3+ years of applied experience.
- Proficiency in Python and software engineering fundamentals, including testing, version control, and code review.
- Experience operating production services and delivering monitored, iterative machine learning and/or LLM features.
- Practical prompt engineering and RAG experience, including evaluation and quality measurement.
Nice to have
- Experience with agent orchestration frameworks such as LangGraph or LlamaIndex, and LLM evaluation tooling.
- Experience with CI/CD, Docker, Kubernetes, vector databases, embedding pipelines, or cloud/ML platforms such as Amazon Web Services or Databricks.
Tools
Python, LangGraph, LlamaIndex, Docker, Kubernetes, Amazon Web Services, Databricks, CI/CD
AI focus
Develop and operate LLM-powered agent platforms; evaluate and monitor LLM systems; apply RAG, prompt engineering, guardrails, governance, and approved AI-assisted software development practices.
Model-written summary · the original posting is authoritative