Capital One
AI Engineer 5 (FM Hosting, LLM Inference)
$230K–$286K
New York, NY +4 · Full-time · Posted Oct 9, 2026
- Location
- New York, NY
San Francisco, CA
McLean, VA
Cambridge, MA
San Jose, CA - Experience
- At least 6 years developing AI and ML algorithms or technologies with a bachelor’s degree, or at least 4 years with a master’s degree; at least 6 years programming. Preferred: 7+ years deploying scalable, responsible AI solutions on cloud platforms.
- Education
- Bachelor's or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields; no equivalent-experience alternative stated.
- Visa sponsorship
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
About the job
Build and optimize scalable foundation-model and LLM inference systems and orchestration pipelines for AI-powered products at Capital One.
What you'll do
- Design, develop, deploy, and support AI components including LLM inference, agents, similarity search, guardrails, evaluation, governance, and observability.
- Optimize production AI systems for scalability, cost, latency, throughput, and hardware utilization; lead cost-performance reviews and technical design reviews.
- Contribute to AI platform strategy, coordinate across teams, and mentor AI engineers.
What they ask for
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years developing AI and ML algorithms or technologies; alternatively, a Master’s degree in those fields plus at least 4 years of such experience.
- At least 6 years programming with Python, Go, Scala, CUDA, or Java.
Nice to have
- Experience leading AI system development and making cost, latency, throughput, and accuracy tradeoffs.
- Experience deploying scalable, responsible AI on cloud platforms; optimizing model training and inference; building agentic systems; or integrating heterogeneous AI systems.
Pay
$229,900 - $262,400 USD base salary (Cambridge, MA); $229,900 - $262,400 USD base salary (McLean, VA); $250,800 - $286,200 USD base salary (New York, NY); $250,800 - $286,200 USD base salary (San Francisco, CA); $250,800 - $286,200 USD base salary (San Jose, CA)
Tools
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, Python, Go, Scala, CUDA
AI focus
Foundation-model training and optimization, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, orchestration, and responsible production AI.
Model-written summary · the original posting is authoritative