Datadog
Staff Applied Scientist - Dashboards
$276K–$345K
New York, New York, USA +1 · Staff · Full-time · Posted Jun 5, 2026
- Location
- New York, New York, USA
New York, NY, United States - Experience
- 10+ years of relevant engineering or applied science experience, including time as a technical lead.
- Education
- BS/MS/PhD in a scientific field, or equivalent experience.
About the job
Define and scale the evaluation strategy for Datadog Dashboards’ AI system, improving agent quality, reliability, and efficiency.
What you'll do
- Set evaluation metrics and strategy across offline and online, quality and cost, and single- and multi-turn use cases.
- Build reusable evaluation datasets, golden traces, and regression harnesses for dashboard and widget agents.
- Improve retrieval relevance, tool-selection accuracy, and context efficiency; provide technical leadership and mentorship.
What they ask for
- BS/MS/PhD in a scientific field, or equivalent experience.
- 10+ years of relevant engineering or applied science experience, including time as a technical lead.
- Track record leading ML or GenAI initiatives in a product-driven environment from research through production.
- Significant experience evaluating, experimenting with, or measuring ML systems at scale.
Pay
$276,000 — $345,000 USD (base salary)
AI focus
Define and evaluate an AI agent system, including answer quality, tool selection, retrieval relevance, latency, token cost, and end-to-end success; improve retrieval, tool selection, and context efficiency.
Model-written summary · the original posting is authoritative