Innodata
AI Voice Evaluation Specialist
Remote - Alabama +14 · Remote · Full-time · Posted Sep 19, 2026
- Location
- Remote - Alabama
Remote - Alaska
Remote - Arkansas
Remote - Delaware
Remote - Florida
Remote - Georgia
Remote - Indiana
Remote - Maryland
Remote - Massachusetts
Remote - New Hampshire
Remote - New Jersey
Remote - New York
Remote - South Carolina
Remote - Texas
ISL - Remote - US - Education
- Bachelor’s degree
About the job
Evaluate and compare two AI models through voice-based conversations, documenting their performance and selecting the stronger model using defined criteria.
What you'll do
- Roleplay the same assigned scenario with two AI models, keeping the conversations comparable.
- Record and assess each interaction across defined dimensions, including relevant audio or conversation error clusters.
- Select the stronger model and write a detailed rationale with examples from both conversations.
What they ask for
- Bachelor’s degree
- Strong listening, comprehension, written communication, critical-thinking, and analytical skills
- Ability to follow detailed evaluation guidelines and compare interactions consistently and objectively
- Comfort speaking naturally and roleplaying conversational scenarios
Nice to have
- Familiarity with AI assistants, voice-based AI, or conversational systems
Pay
$20-$25 per hour (hourly salary)
AI focus
Evaluate and compare the conversational performance of AI models using structured voice-based interactions.
Model-written summary · the original posting is authoritative