Thomson Reuters
Lead Research Engineer – AI Evaluation & Benchmarking
$127K–$273K
United States of America, Eagan, Minnesota +4 · Hybrid · Full-time · Posted Oct 30, 2026
- Location
- United States of America, Eagan, Minnesota
United States of America, Frisco, Texas
United States of America, New York, New York
Canada, Toronto, Ontario
United States of America, Ann Arbor, Michigan - Experience
- 8-10+ years of relevant software engineering experience, including production systems involving machine learning or complex data.
- Education
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
About the job
Leads the development of production-ready infrastructure and tools for evaluating and benchmarking AI models, enabling teams to compare quality, cost, and latency and make informed model decisions.
What you'll do
- Plan and lead technical delivery, including project scope, estimates, dependencies, and engineering decisions.
- Build scalable Python software, APIs, and automated evaluation pipelines; make comparisons reliable, reproducible, and traceable.
- Deliver production-ready tools and reports, ensuring reliability, performance, responsible data use, and effective collaboration across teams.
What they ask for
- Strong Python skills, including API design, automated testing, and structured and unstructured data.
- Technical leadership and end-to-end delivery experience, including architecture, planning, estimation, and adapting priorities.
- Experience translating research methods into software and integrating or testing machine-learning models; understanding of language models and evaluation reliability.
- Cloud engineering experience (AWS, Azure, or comparable), plus working knowledge of SQL.
Nice to have
- Experience building LLM evaluation and benchmarking pipelines, including automated scoring or human assessment.
- Familiarity with experiment tracking, dataset versioning, and reproducible evaluation processes.
Pay
$146,800 USD - $272,600 USD (base salary); $127,400 USD - $236,600 USD (base salary); $140,000 CAD - $175,000 CAD (base salary)
Tools
Python, AWS, Azure, SQL, LLMs
AI focus
Builds evaluation and benchmarking infrastructure for LLMs and other AI models, measuring quality, cost, and latency and supporting reproducible model comparisons.
Model-written summary · the original posting is authoritative