Agent Data Scientist

What you'll do

• Work with customers to define and operationalize trusted performance metrics, and deliver transparent reporting.
• Diagnose performance, design experiments, and drive improvements to key account metrics.
• Build measurement tools and frameworks, define success for new initiatives, and provide feedback to Product, Engineering, and Research.

What they ask for

• 5+ years in data science, analytics, or another quantitative role, driving analyses end to end and using them to influence decisions.
• Fluency in SQL and Python, and comfort with large volumes of messy, unstructured conversational data.
• Ability to align stakeholders on a shared definition of success.
• Strong independence and judgment in ambiguous, fast-moving situations.

Nice to have

• History of building internal tools that gained meaningful adoption.
• Experience with production AI products, including evaluating LLM or agent behavior and building evaluations.

Pay

$165K-$215K (USD, base salary); equity amount not stated

Tools

SQL, Python, LLM

AI focus

Measures and improves AI agent performance, including defining and building evaluations for LLM or agent behavior.