Alaffia Health
ML Ops Engineer
New York, New York, US · Full-time · Posted Oct 8, 2026
- Experience
- 5+ years in MLOps, ML platforms, or ML infrastructure engineering.
- Visa sponsorship
- Requires current authorization to work in the United States; work visa sponsorship is not available.
About the job
Build and operate the MLOps systems and improve the models powering production AI agents that review healthcare claims.
What you'll do
- Build agent evaluation, observability, and CI/CD systems to measure quality, throughput, cost, and regressions.
- Manage model access, experiments, and versioned deployment of agents across cloud providers and customers.
- Develop, fine-tune, and evaluate LLMs and machine learning models for claim-review agents; optimize inference costs.
What they ask for
- 5+ years of experience in MLOps, ML platforms, or ML infrastructure engineering.
- Strong software engineering fundamentals and proficiency in Python.
- Hands-on experience developing, training, and fine-tuning machine learning models and/or LLMs.
- Experience building ML or LLM evaluation frameworks and CI/CD pipelines with automated testing.
Nice to have
- Experience operating multi-tenant production systems or ML services at scale.
- Experience in regulated or healthcare environments, agent frameworks, or collaborating with clinical experts.
Tools
Python, AWS Bedrock, SageMaker, Azure OpenAI, Azure ML, MLflow, Weights & Biases
AI focus
Develop, fine-tune, evaluate, and operate LLMs, machine learning models, and AI agents for automated healthcare claims review.
Model-written summary · the original posting is authoritative