Toloka AI / careers
← All positions

Model evaluation · Toloka AI

AI Voice Evaluation Specialist - 3 Month Contract

United StatesRemoteContract

Role Summary

Compare two conversational AI models through matched live voice interactions. Use consistent scenarios and structured scoring to determine which provides the stronger conversational experience.

This published opportunity is available through Toloka AI. Review the listing carefully for the specific work arrangement and requirements.

Responsibilities

Roleplay the same scenario with both models. Keep conversational approach and turn counts comparable. Record interactions and score five evaluation dimensions. Identify audio and conversational error clusters. Select the stronger model and explain the judgment.

Qualifications

Bachelor's degree; strong listening, writing, analytical judgment, and attention to detail; comfort with roleplay; familiarity with conversational AI.

Preferred Qualifications

Not disclosed

Benefits

Not disclosed

What happens next

Submit your interest online to receive a reference number. The opportunity owner or review team may contact selected applicants about next steps.

For accommodation requests, contact [email protected].