Role Summary
Evaluate language-model outputs and behavior using structured questions and quality criteria. The work supports improvements to language, reasoning, relevance, and overall response quality.
This published opportunity is available through Toloka AI. Review the listing carefully for the specific work arrangement and requirements.
Responsibilities
Score output quality, appropriateness, and relevance. Rank alternatives against defined criteria. Check whether product features follow project guidelines. Create evaluation prompts and rewrite unclear text.
Qualifications
Bachelor's degree or higher in a humanities field; C1/C2 English proficiency.
Preferred Qualifications
Master's or doctoral degree.
Benefits
Not disclosed
What happens next
Submit your interest online to receive a reference number. The opportunity owner or review team may contact selected applicants about next steps.
For accommodation requests, contact [email protected].