Innodata
AI Agentic Workflow Reviewer
In Office - San Jose, California +1 · Remote · Full-time · Posted Sep 19, 2026
- Location
- In Office - San Jose, California
ISL - Remote - US - Experience
- 2–5+ years in a relevant review role.
- Education
- Bachelor's degree or equivalent practical experience.
About the job
Reviews complex, multi-step AI agent workflows for task success, safety, policy adherence, user agency, and informed consent.
What you'll do
- Assess agent task trajectories using structured rubrics, including privacy guardrails for sensitive or personal data.
- Verify isolated test environments are reset between runs and flag or escalate safety-relevant or ambiguous findings.
- Clearly document and justify scoring decisions for auditability.
What they ask for
- Bachelor's degree or equivalent practical experience.
- 2–5+ years in quality review, QA/QC, trust & safety, content moderation, data annotation, or a similar judgment-intensive review role.
- Strong written communication and comfort making structured decisions under ambiguity.
- Baseline understanding of AI/ML concepts and how AI agents complete tasks; familiarity may be learned through onboarding.
Pay
$50-$55p/hour (USD, hourly salary)
AI focus
Evaluates agentic AI workflows for task success, safety, policy adherence, user agency, informed consent, and privacy.
Model-written summary · the original posting is authoritative