Jobless Developer
TSMG logo
TSMG

Posted 25 months ago

Open

Evaluators for AI training (English language)

Ivano-FrankivskRemotePart-time

AI Summary

Evaluator reviews AI agent replies to assess safety and quality, comparing responses and rating them against provided guidelines.

About this role

We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).

The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.

Full online training is provided.

The role is fully remote with the possibility of having a flexible schedule.
We are open to both full-time and part-time candidates.

Requirements:

  • at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
  • attention to detail
  • time-management skills
  • proactive approach
  • curious mind

    • Responsibilities:

  • evaluate replies of the AI agent according to the provided guidelines
  • recognize and evaluate differences between two possible responses to a request
  • compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating

    • Skills

    AI Model EvaluationContent SafetyEnglish Reading ComprehensionGuideline AdherenceQuality ScoringRisk AssessmentText AnalysisUltra-precise Judgment

    Explore related jobs

    More jobs at TSMG

    Similar AI Model Evaluation jobs

    Jobs in Ivano-Frankivsk

    Browse these categories

    Risk Assessment JobsJobs in Ukraine