Jobless Developer
Welo Global logo

Posted Today

Open

Andromeda Sadiradra - Audio Rater - Generalist - English (Canada)

CanadaRemote

AI Summary

Evaluates recorded conversations between users and AI voice agents by rating response quality on content and prosody scales and writing justifications for scores.

About this role

Overview:

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

Project Details:

Start Date: ASAP

Duration: 10 hours/week

Job Type: Freelance

Location: Remote (Canada)

Language: English

Pay Rate: $26.00/hour

Responsibilities

  • Listen carefully to recorded conversations between a person and an AI voice agent
  • Rate each of the agent's turns on two independent 1–5 scales:
    • Content – Was the response helpful, relevant, and appropriate?
    • Prosody – Did the voice sound natural, well-paced, and expressive?
    • Write a short, specific, and clear justification for each score given

What We're Looking For:

  • Strong listening and attention-to-detail skills
  • Ability to give consistent, well-reasoned ratings
  • Clear, concise written communication
  • Reliable availability for ~10 hours/week
  • Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!

Skills

Attention To DetailAudio EvaluationListening SkillsRating ScalesWritten Communication

Explore related jobs

Browse these categories

Market data for this role

All reports →