Happyrobot
Data Scientist
San Francisco +1 · On-site · Full-time · Posted Jul 14, 2026
- Location
- San Francisco
Barcelona - Experience
- 4+ years in Data Science, Product Analytics, or another highly quantitative product role.
About the job
Measure and analyze how HappyRobot’s AI agents, models, and product features perform in real-world use, using experiments and data to guide product and machine learning decisions.
What you'll do
- Define product and agent metrics; design, run, and interpret A/B tests and model evaluations.
- Analyze conversations, workflows, and product usage to assess customer outcomes, investigate performance changes, and recommend improvements.
- Partner with Product, Engineering, and Machine Learning teams on instrumentation, data quality, analytical tools, and communicating findings.
What they ask for
- Strong experience in experimental design, A/B testing, statistics, causal inference, and hypothesis-driven analysis.
- Advanced proficiency in SQL and Python.
- Experience defining and operationalizing product and feature metrics.
- Ability to translate ambiguous product questions into rigorous analyses and actionable recommendations.
Nice to have
- Experience with large language models, AI agents, generative AI, or other probabilistic ML products.
- Experience measuring production impacts of model, prompt, retrieval, or orchestration changes.
Tools
SQL, Python
AI focus
Evaluate and analyze the real-world performance and customer impact of AI agents, models, prompts, workflows, and product features.
Model-written summary · the original posting is authoritative