Senior Data Scientist

What you'll do

• Own AI evaluation projects from problem definition through implementation, and communicate findings.
• Build and improve closed-loop LLM-as-a-Judge evaluation infrastructure, including datasets, benchmarks, calibration, error analysis, and production feedback.
• Develop evaluation frameworks, datasets, pipelines, and dashboards; collaborate with engineering and product teams and mentor junior data scientists.

What they ask for

• 5+ years of industry experience in data science, machine learning, or a related quantitative field.
• Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Mathematics, or a related quantitative field.
• Proficiency in Python; experience with large-scale datasets and data pipelines.
• Strong foundation in statistical analysis, experimental design, hypothesis testing, and A/B testing; familiarity with evaluation metrics such as precision, recall, and Cohen's Kappa.

Nice to have

• NLP, LLM, or speech technology evaluation experience; regulated-industry experience and familiarity with PII/PHI data governance.
• MLOps and production deployment experience; familiarity with Langfuse, GCP, AWS, Azure, or Databricks.

Pay

$180k-230k USD (base salary)

Tools

Python, Pydantic, Pandas, NumPy, Scikit-learn, Langfuse, GCP, AWS

AI focus

Evaluates and improves LLM- and speech-based conversational AI, including LLM-as-a-Judge systems, datasets, benchmarks, calibration, and quality monitoring.