Innodata
AI Voice Evaluation Specialist - 3 month contract
Remote - United States +1 · Remote · Full-time · Posted Oct 14, 2026
- Location
- Remote - United States
ISL - Remote - US - Experience
- No years of experience specified.
- Education
- Bachelor’s degree.
About the job
Evaluate two AI models through comparable voice-based roleplay conversations, assess their responses, and document which provides the stronger conversational experience.
What you'll do
- Conduct consistent, recorded voice conversations with two AI models using the same assigned scenario.
- Evaluate both models across defined criteria, identify error clusters, and select the stronger performer.
- Write a detailed rationale comparing the models and apply evaluation guidelines consistently.
What they ask for
- Bachelor’s degree.
- Strong listening, comprehension, written communication, critical-thinking, and analytical skills.
- Ability to follow detailed guidelines and compare interactions objectively and consistently.
- Comfort speaking naturally and role-playing conversational scenarios.
Nice to have
- Familiarity with AI assistants, voice-based AI, or conversational systems.
Pay
$20-$25 p/hour (USD, hourly salary; contract pay)
AI focus
Evaluate AI models through voice conversations, comparing conversational quality and identifying errors.
Model-written summary · the original posting is authoritative