[Hiring] Audio Rater @Welocalize

Role Description

We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions.

• Listen carefully to recorded conversations between a person and an AI voice agent
• Rate each of the agent's turns on two independent 1–5 scales:
  • Content – Was the response helpful, relevant, and appropriate?
  • Prosody – Did the voice sound natural, well-paced, and expressive?
• Write a short, specific, and clear justification for each score given

Qualifications

• Strong listening and attention-to-detail skills
• Ability to give consistent, well-reasoned ratings
• Clear, concise written communication
• Reliable availability for ~10 hours/week

Requirements

• Start Date: ASAP
• Duration: 10 hours/week
• Job Type: Freelance
• Location: Remote (United States)
• Language: English (United States)
• Pay Rate: US $26.33/hour

Benefits

• Opportunity to contribute to an exciting project

Company Description

Thank you for your interest in joining Welo Data's community and contributing to this exciting project. We look forward to collaborating with you!