Capital One
AI Engineer 5 (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning)
$230K–$286K
New York, NY +4 · Full-time · Posted Sep 18, 2026
- Location
- New York, NY
San Francisco, CA
McLean, VA
Cambridge, MA
San Jose, CA - Experience
- At least 6 years developing AI and ML algorithms or technologies with a bachelor's degree, or at least 4 years with a master's degree; at least 6 years programming. Preferred: 7 years deploying scalable and responsible cloud AI solutions.
- Education
- Bachelor's or Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.
- Visa sponsorship
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
About the job
Develop and optimize foundational AI systems and production LLM solutions, including model training, inference, orchestration, and governance.
What you'll do
- Design, build, deploy, and support AI components such as foundation model training, LLM inference, agents, similarity search, guardrails, evaluation, and observability.
- Develop optimization techniques and orchestration pipelines to improve AI system scalability, cost, latency, throughput, and performance.
- Contribute to AI technical roadmaps, lead design and cost-performance reviews, and mentor AI engineers.
What they ask for
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in those fields plus at least 4 years of such experience.
- At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
Nice to have
- Experience leading development of AI systems and making cost, latency, throughput, and accuracy tradeoffs.
- Experience deploying scalable, responsible AI solutions on cloud platforms; the posting specifies 7 years.
Pay
USD $229,900 - $262,400 base salary (Cambridge, MA); USD $229,900 - $262,400 base salary (McLean, VA); USD $250,800 - $286,200 base salary (New York, NY); USD $250,800 - $286,200 base salary (San Francisco, CA); USD $250,800 - $286,200 base salary (San Jose, CA)
Tools
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, Python, Go, Scala, CUDA
AI focus
Foundation model training and optimization, LLM inference and customization, agents and multi-agent workflows, similarity search, AI orchestration, evaluation, guardrails, and responsible AI governance.
Model-written summary · the original posting is authoritative