Alaffia Health
AI Engineer
New York, New York, US · Full-time · Posted Oct 26, 2026
- Experience
- 3+ years in applied ML or AI engineering.
- Visa sponsorship
- Requires current authorization to work in the United States; work visa sponsorship is not available.
About the job
Build and productionize AI agents, LLMs, and RAG systems that review health-plan claims using policies, contracts, clinical evidence, and auditor feedback.
What you'll do
- Design multi-agent claim-review workflows with planning, tool use, memory, and multi-step reasoning; develop and fine-tune LLMs and RAG pipelines.
- Apply reinforcement learning and clinical-auditor feedback, and evaluate models and agents for accuracy, grounding, and retrieval quality.
- Integrate models into production while optimizing latency, cost, reliability, PHI security, HIPAA compliance, and auditability.
What they ask for
- Strong software engineering fundamentals and proficiency in Python.
- Experience developing AI agents and agentic workflows, including tool calling, orchestration, and multi-step reasoning.
- Hands-on LLM fine-tuning and training pipelines; production RAG experience including vector databases, embeddings, and retrieval optimization.
- Practical LLM reinforcement learning experience and strong understanding of LLM evaluation and experiment tracking.
Nice to have
- Experience with agent frameworks such as LangGraph, LangChain, or LlamaIndex; LLM provider APIs or self-hosted model serving.
- Experience with distributed training, GPU infrastructure, AI tooling, or healthcare data and other regulated domains.
Tools
Python, PyTorch, Hugging Face, LangGraph, LangChain, LlamaIndex, vLLM, TGI
AI focus
Develop agentic systems for claims review; fine-tune healthcare LLMs; build grounded RAG; apply RLHF, DPO, and reward modeling; evaluate and safely productionize AI for medical billing and auditing.
Model-written summary · the original posting is authoritative