Innodata
Engagement Manager, Agentic AI Workflow Evaluations
In Office - San Jose, California +1 · Remote · Manager · Full-time · Posted Sep 19, 2026
- Location
- In Office - San Jose, California
ISL - Remote - US - Experience
- 5+ years of professional experience, including direct management of a delivery team of 10–20 people.
- Education
- Bachelor's degree or equivalent practical experience.
About the job
Leads an onsite team evaluating agentic AI workflows, owning delivery quality and throughput, customer engagement, reviewer management, and account growth.
What you'll do
- Manage end-to-end delivery, including throughput, quality, turnaround, and staffing capacity.
- Lead and develop a team of eleven; serve as the customer’s onsite contact and report metrics, resolve issues, and escalate findings.
- Audit evaluation work, partner on calibration and rubric refinement, and identify opportunities to expand the engagement.
What they ask for
- Bachelor's degree or equivalent practical experience.
- 5+ years of professional experience, including direct management of a delivery team of 10–20 people.
- Experience owning a customer-facing services or delivery engagement with an enterprise or technology client, including metrics reporting and issue escalation.
- Significant AI/ML evaluation experience and ability to critically assess rubric-scored work.
Pay
$75-85 p/hour (hourly salary; base pay)
Tools
AI/ML
AI focus
Evaluates agentic AI workflows for task completion, safety, user intent, and consent; audits scoring, supports calibration and rubric refinement, and escalates safety-relevant or ambiguous findings.
Model-written summary · the original posting is authoritative