[Hiring] Audio Rater @Welo Global

Role Description

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

• Listen carefully to recorded conversations between a person and an AI voice agent.
• Rate each of the agent's turns on two independent 1–5 scales:
  • Content – Was the response helpful, relevant, and appropriate?
  • Prosody – Did the voice sound natural, well-paced, and expressive?
• Write a short, specific, and clear justification for each score given.

Qualifications

• Strong listening and attention-to-detail skills.
• Ability to give consistent, well-reasoned ratings.
• Clear, concise written communication.
• Reliable availability for ~10 hours/week.

Requirements

• Start Date: ASAP
• Duration: 10 hours/week
• Job Type: Freelance
• Location: Remote (Ireland)
• Language: English
• Pay Rate: $27.30/hour

Benefits

• Competitive pay rate of $27.30/hour.

Company Description

Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!