Senior Data Scientist, Data Quality and AI Evaluation

What you'll do

• Define quality metrics, maintain human-verified datasets, and analyze sensor, camera, and annotation data for systematic errors.
• Develop failure-clustering and data-selection approaches; design audits, experiments, and release acceptance criteria.
• Improve labeling guidelines and reviewer consistency, and communicate findings through dashboards and recommendations.

What they ask for

• Foundations in statistics, experimental design, sampling, hypothesis testing, and uncertainty estimation, with practical ML-system and data-quality evaluation experience.
• AI/LLM evaluation experience and proficiency in Python and SQL, including large-dataset analysis and reproducible workflows.
• Ability to distinguish reference-label defects from model errors and turn quality concerns into measurable questions and recommendations.
• Strong communication and teamwork skills; 12+ years of industry experience.

Nice to have

• Autonomous driving, robotics, or computer vision experience, especially with camera and LiDAR data or 2D/3D annotations.
• Experience with human-in-the-loop labeling and audit workflows, annotator agreement, or versioned benchmarks.

Pay

224,000 USD – 356,500 USD (base salary, Level 5); 272,000 USD – 431,250 USD (base salary, Level 6)

Tools

Python, SQL

AI focus

Evaluates AI/LLM systems and auto-labeling pipelines for autonomous driving, including failure analysis, data quality, and evaluation methods.