Ambience Healthcare
Staff ML Engineer, Frontier AI
San Francisco · Staff · Full-time · Posted Mar 17, 2026
- Experience
- 7+ years in production ML, research engineering, or applied AI.
About the job
Leads the design and production improvement of clinical AI systems, setting technical direction for evaluation, post-training, agentic systems, and cross-product AI quality.
What you'll do
- Define AI quality and evaluation strategy, including metrics, graders, regression testing, and validation.
- Lead production model improvements across prompting, retrieval, data, routing, and post-training; build feedback loops that turn failures into better systems.
- Set technical direction and roadmap for agentic AI systems, while mentoring engineers and driving cross-team initiatives.
What they ask for
- 7+ years in production ML, research engineering, or applied AI.
- Deep expertise in modern LLMs, transformers, production AI systems, and evaluation of complex AI systems.
- Experience building or architecting production agentic systems and materially improving model behavior through post-training or adaptation.
- Proficient in Python and modern ML frameworks; comfortable with MLOps, CI/CD, observability, and containerized deployments.
Nice to have
- PyTorch preferred.
- Experience with realtime voice, conversational AI, or multimodal systems; healthcare, clinical AI, regulated industries, ML hiring, or relevant open-source contributions.
Tools
Python, PyTorch, LLMs, transformers, MLOps, CI/CD
AI focus
Improve clinical AI through LLM and agent evaluation, post-training, agentic systems, and production feedback loops, including clinical documentation, diagnosis prediction, and decision support.
Model-written summary · the original posting is authoritative