Role Summary
Compare two conversational AI models through matched live voice interactions. Use consistent scenarios and structured scoring to determine which provides the stronger conversational experience.
This published opportunity is available through Toloka AI. Review the listing carefully for the specific work arrangement and requirements.
Responsibilities
Roleplay the same scenario with both models. Keep conversational approach and turn counts comparable. Record interactions and score five evaluation dimensions. Identify audio and conversational error clusters. Select the stronger model and explain the judgment.
Qualifications
Bachelor's degree; strong listening, writing, analytical judgment, and attention to detail; comfort with roleplay; familiarity with conversational AI.
Preferred Qualifications
Not disclosed
Benefits
Not disclosed
What happens next
Submit your interest online to receive a reference number. The opportunity owner or review team may contact selected applicants about next steps.
For accommodation requests, contact [email protected].