Capital One
AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)
$197K–$246K
New York, NY +4 · Full-time · Posted Sep 21, 2026
- Location
- New York, NY
San Francisco, CA
McLean, VA
Cambridge, MA
San Jose, CA - Experience
- At least 4 years developing AI and ML algorithms or technologies with a bachelor’s degree, or at least 2 years with a master’s degree; at least 4 years programming. Preferred: 6 years deploying scalable and responsible AI solutions on cloud platforms.
- Education
- Bachelor’s or Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.
- Visa sponsorship
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
About the job
Build and optimize foundational AI systems, LLM services, and agentic workflows that power responsible AI products across Capital One.
What you'll do
- Design, develop, test, deploy, and support AI components, including foundation model training, LLM inference, agents, search, guardrails, evaluation, and observability.
- Optimize production AI systems for scalability, cost, latency, throughput, and hardware utilization.
- Own complex AI system architecture and contribute to technical roadmaps, reliability objectives, and deployment reviews.
What they ask for
- Bachelor’s degree in a related field plus at least 4 years developing AI and ML algorithms or technologies, or a Master’s degree in a related field plus at least 2 years of that experience.
- At least 4 years programming with Python, Go, Scala, CUDA, or Java.
Nice to have
- Experience leading AI system development and making cost, latency, throughput, and accuracy tradeoffs.
- Experience deploying scalable, responsible AI solutions on cloud platforms; building agentic systems; or optimizing training and inference.
Pay
Cambridge, MA: $197,300 - $225,100 USD base salary; McLean, VA: $197,300 - $225,100 USD base salary; New York, NY: $215,200 - $245,600 USD base salary; San Francisco, CA: $215,200 - $245,600 USD base salary; San Jose, CA: $215,200 - $245,600 USD base salary
Tools
Python, Go, Scala, CUDA, Java, AWS Ultraclusters, Huggingface, PyTorch
AI focus
Develop foundation models, LLM inference, agentic and multi-agent workflows, similarity search, guardrails, model evaluation, governance, and observability; optimize AI training and inference for performance and responsible production use.
Model-written summary · the original posting is authoritative