Capital One
AI Engineer 5 (FM Hosting, LLM Inference)
$230K–$286K
McLean, VA +3 · Full-time · Posted Sep 24, 2026
- Location
- McLean, VA
Cambridge, MA
San Jose, CA
New York, NY - Experience
- At least 6 years developing AI and ML algorithms or technologies with a bachelor's degree, or at least 4 years with a master's degree; at least 6 years programming. Preferred: 7 years deploying scalable and responsible AI solutions on cloud platforms.
- Education
- Bachelor's or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.
- Visa sponsorship
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
About the job
Build and optimize foundational AI systems, including large language model inference and multi-model orchestration, for scalable production use at Capital One.
What you'll do
- Design, develop, deploy, and support AI components such as foundation model training, LLM inference, agents, similarity search, guardrails, evaluation, and observability.
- Optimize production AI systems for scalability, cost, latency, throughput, and hardware utilization; establish cost-performance governance.
- Shape foundational AI technical direction, lead design reviews, and mentor AI engineers.
What they ask for
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years developing AI and ML algorithms or technologies; or a Master's degree in these fields plus at least 4 years of that experience.
- At least 6 years programming with Python, Go, Scala, CUDA, or Java.
Nice to have
- Experience leading AI system development with cost, latency, throughput, and accuracy tradeoffs.
- Experience deploying scalable, responsible AI solutions on cloud platforms; the posting specifies 7 years for this qualification.
Pay
$229,900 - $262,400 USD base salary (Cambridge, MA); $229,900 - $262,400 USD base salary (McLean, VA); $250,800 - $286,200 USD base salary (New York, NY); $250,800 - $286,200 USD base salary (San Jose, CA)
Tools
Python, Go, Scala, CUDA, Java, AWS Ultraclusters, Huggingface, PyTorch
AI focus
Develop and optimize foundation model training and LLM inference, agentic and multi-agent workflows, similarity search, guardrails, evaluation, and multi-model orchestration; improve production AI performance, cost, and hardware utilization.
Model-written summary · the original posting is authoritative