Airbnb
Senior Staff Machine Learning Engineer, Data & Eval
$244K–$305K
United States · Senior Staff · Full-time · Posted Mar 30, 2025
- Experience
- 10+ years building, testing, and shipping ML/AI systems end-to-end, including 2+ years with production GenAI/LLM systems; 5+ years leading large, ambiguous technical initiatives as a senior IC.
- Education
- PhD in Computer Science, Mathematics, Statistics, or related technical field (or equivalent practical experience).
About the job
Leads technical strategy and execution for ML evaluation and data flywheels that continuously improve Airbnb Assistance Engineering models and products.
What you'll do
- Define GenAI evaluation strategies and metrics, linking offline measures to online outcomes.
- Build evaluation frameworks and data pipelines for feedback, dataset quality, monitoring, and continuous testing.
- Lead cross-functional quality initiatives and architecture decisions for scalable evaluation and data infrastructure.
What they ask for
- PhD in Computer Science, Mathematics, Statistics, or a related technical field, or equivalent practical experience.
- 10+ years building, testing, and shipping ML/AI systems end-to-end, including 2+ years with production GenAI/LLM systems.
- 5+ years leading large, ambiguous technical initiatives as a senior IC and influencing direction across teams.
- Deep evaluation expertise and hands-on experience with GenAI systems, data pipelines, and ML fundamentals.
Nice to have
- Experience applying ML/AI to customer support workflows.
- Experience building evaluation platforms for agent behavior, safety, and continuous improvement.
Pay
$244,000 — $305,000 USD (base salary)
Tools
GenAI, LLM, RAG/Search, LLM-as-judge
AI focus
Develops evaluation systems, feedback-based learning, and data flywheels to improve GenAI assistance systems safely and continuously.
Model-written summary · the original posting is authoritative