[Hiring] English Audio Rater @Welo Data

Role Description

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

• Listen carefully to recorded conversations between a person and an AI voice agent
• Rate each of the agent's turns on two independent 1–5 scales:
  • Content – Was the response helpful, relevant, and appropriate?
  • Prosody – Did the voice sound natural, well-paced, and expressive?
• Write a short, specific, and clear justification for each score given

Qualifications

• Strong listening and attention-to-detail skills
• Ability to give consistent, well-reasoned ratings
• Clear, concise written communication
• Reliable availability for ~10 hours/week

Requirements

• Start Date: ASAP
• Duration: 10 hours/week
• Job Type: Freelance
• Location: Remote (New Zealand)
• Language: English (New Zealand)
• Pay Rate: US $22.1/hour

Company Description

Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!