Toloka AI / careers
← All positions

Model evaluation · Toloka AI

AI Evaluator - Flexible Hours

United StatesRemotePart-time

Role Summary

Evaluate language-model outputs and behavior using structured questions and quality criteria. The work supports improvements to language, reasoning, relevance, and overall response quality.

This published opportunity is available through Toloka AI. Review the listing carefully for the specific work arrangement and requirements.

Responsibilities

Score output quality, appropriateness, and relevance. Rank alternatives against defined criteria. Check whether product features follow project guidelines. Create evaluation prompts and rewrite unclear text.

Qualifications

Bachelor's degree or higher in a humanities field; C1/C2 English proficiency.

Preferred Qualifications

Master's or doctoral degree.

Benefits

Not disclosed

What happens next

Submit your interest online to receive a reference number. The opportunity owner or review team may contact selected applicants about next steps.

For accommodation requests, contact [email protected].