[Hiring] English (Canada) Audio Rater @Welo Data

Role Description

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

• Listen carefully to recorded conversations between a person and an AI voice agent
• Rate each of the agent's turns on two independent 1–5 scales:
  • Content – Was the response helpful, relevant, and appropriate?
  • Prosody – Did the voice sound natural, well-paced, and expressive?
• Write a short, specific, and clear justification for each score given

Qualifications

• Strong listening and attention-to-detail skills
• Ability to give consistent, well-reasoned ratings
• Clear, concise written communication
• Reliable availability for ~10 hours/week

Requirements

• Start Date: ASAP
• Duration: 10 hours/week
• Job Type: Freelance
• Location: Remote (Canada)
• Language: English (Canada)
• Pay Rate: US $26/hour

Company Description

Join our team at Welo Data and embark on a journey of growth and innovation.