Abridge
Member of Product Staff, AI/ML (Evals)
$250K–$290K
SF Office · Hybrid · Staff · Full-time · Posted Jun 22, 2026
- Experience
- 5+ years of product management experience.
About the job
Leads product strategy and execution for Abridge’s shared AI evaluation platform, enabling product teams to measure, compare, and monitor model quality across the product lifecycle.
What you'll do
- Own the evaluation platform roadmap, shared measurement infrastructure, and product outcomes.
- Establish model evaluation standards, model-selection processes, and quality gates across product teams.
- Coordinate with engineering, ML, data science, and clinical science teams on evaluation workflows and production quality.
What they ask for
- 5+ years of product management experience with significant ownership of ML-powered products or platform systems.
- Deep understanding of model quality measurement, including evaluation frameworks, annotation pipelines, and benchmark design.
- Strong technical fluency across ML, data pipelines, and distributed systems.
- Experience working closely with ML researchers and engineers to drive production impact.
Nice to have
- Experience building evaluation platforms, ML observability systems, or quality measurement pipelines.
- Experience in clinical, healthcare, or regulated environments, or with domain-specific model adaptations.
Pay
$250K – $290K (base salary)
Tools
LLM judges, rule-based evaluators, human annotation, online monitoring, ML, data pipelines, distributed systems
AI focus
Builds the evaluation platform and operating standards for measuring, comparing, and monitoring AI model quality, including frontier and specialty models, across healthcare products.
Model-written summary · the original posting is authoritative