Datadog
Staff Applied Scientist - Agentic Interfaces
$276K–$345K
New York, New York, USA +1 · Staff · Full-time · Posted May 29, 2026
- Location
- New York, New York, USA
New York, NY, United States - Experience
- 10+ years of relevant engineering or applied science experience, including time as a technical lead.
- Education
- BS/MS/PhD in a scientific field, or equivalent experience.
About the job
Defines and builds evaluation systems to measure and improve the quality, cost, and effectiveness of Datadog’s AI agent integrations.
What you'll do
- Own evaluation strategy, metrics, datasets, and regression harnesses for AI agent integrations.
- Conduct applied research and drive improvements in retrieval relevance, tool selection, grounding, and context efficiency.
- Provide technical leadership and partner with product teams to apply shared evaluation systems across first- and third-party agents.
What they ask for
- BS/MS/PhD in a scientific field, or equivalent experience.
- 10+ years of relevant engineering or applied science experience, including time as a technical lead.
- Track record leading ML or GenAI initiatives in a product-driven environment from research through production.
- Significant experience evaluating, experimenting with, or measuring ML systems at scale.
Pay
$276,000–$345,000 USD yearly salary (base salary)
Tools
MCP Server
AI focus
Develops evaluation methods and measurement systems for AI agents, including agent trajectories, tool selection, retrieval, grounding, hallucination control, and cost-quality tradeoffs.
Model-written summary · the original posting is authoritative