Firecrawl
Research Engineer - Evals
San Francisco HQ +1 · Hybrid · Full-time · Posted Jul 12, 2026
- Location
- San Francisco HQ
Toronto Hub - Experience
- 4+ years in ML, research engineering, or data-heavy backend, with real evaluation work.
- Visa sponsorship
- Candidates must already be authorized to work in the US or Canada. US support includes H-1B transfers, F-1 OPT and STEM OPT, TN (Canada and Mexico), and E-3 (Australia); new H-1B visa sponsorship for candidates outside the US is unavailable. Canadian work permit sponsorship may be considered case by case through the Toronto Hub.
About the job
Build evaluation systems to measure the quality of Firecrawl’s web-to-data outputs and feed results into model and product decisions.
What you'll do
- Design quality metrics and evaluation datasets for diverse websites, formats, and edge cases.
- Build scalable pipelines and harnesses to measure output quality rigorously.
- Use evaluation results to guide model and product decisions.
What they ask for
- Engineering depth to build evaluation systems, not just run existing ones.
- Strong interest in defining and rigorously measuring output quality.
- Comfort owning ambiguous problems where metrics need to be invented.
- Move quickly by shipping, measuring, and iterating.
Pay
$250,000–$290,000 USD/year (SF) / $210,000–$224,000 CAD/year (Toronto) — base salary
AI focus
Evaluate the quality of web data used by AI agents and connect evaluation findings to model and product decisions.
Model-written summary · the original posting is authoritative