Sr Data Scientist, Online Experimentation

What you'll do

• Design and validate experimental methods, diagnostics, and guidance; help teams develop, size, and interpret experiments.
• Build and evaluate LLM-based and agentic workflows for experiment design review, instrumentation checks, readouts, and anomaly triage.
• Communicate findings and recommendations, support project prioritization, and mentor colleagues while setting technical standards.

What they ask for

• Legally permitted to work in the United States and at least 18 years of age.
• Bachelor's degree or equivalent degree in a related field; the knowledge, skills, and abilities may be acquired through a bachelor's degree program or equivalent degree.
• At least 5 years of work experience; preferred qualifications specify 6+ years of quantitative analytics experience, including end-to-end ownership of online controlled experiments.
• Preferred qualifications include expertise in experimental design, hypothesis testing, power analysis and causal inference; Python or R and SQL; production or near-production LLM workflows and AI evaluation.

Nice to have

• Advanced degree (MS or PhD) in a quantitative field.
• Experience with experimentation platforms, statistics engines, e-commerce or retail metrics, mentoring, and collaborative code review.

Tools

Python, R, SQL, Google BigQuery, LLMs

AI focus

Design, build, and evaluate LLM-based and agentic workflows to automate experimentation design review, instrumentation checks, readout drafting, and anomaly triage; define evaluation standards including offline benchmarks, human review loops, and regression monitoring.