[Hiring] Generative Audio Evaluation Specialist @RWS TrainAI

Role Description

We’re currently hiring AI Generalists to join a highly specialized evaluation project focused on testing and assessing the performance of a cutting-edge generative audio model. Your work will play an important role in identifying performance issues and providing feedback that can help improve the model.

You will evaluate AI-generated audio for short video and text-to-audio tasks, following detailed project guidelines. Your main responsibilities will include:

• Audio Quality & Naturalness: Assess speech, background music, and sound effects for clarity, quality, and naturalness.
• Audio-Video Alignment: Evaluate synchronization between the generated audio and video, including lip-sync and timing.
• Caption Compliance: Check whether the generated audio accurately follows the provided text captions and task requirements.
• Voice Quality: Evaluate whether generated voices sound natural and, where applicable, match the reference audio.
• Evaluation & Feedback: Assign accurate scores and identify issues according to the provided evaluation guidelines.

Qualifications

• Native-level fluency in Dutch
• Strong attention to detail and excellent listening skills
• Ability to follow detailed evaluation guidelines consistently
• Good understanding of spoken language, audio quality, and context
• Reliable equipment — high-quality headphones are required
• Ability to complete the evaluation test within 48 hours of receiving the assignment

Requirements

• Application
• Screening Survey
• Language Knowledge Assessments
• RWS Vendor Onboarding
• Internal Testing
• Project-specific testing will be required, such as TTS Evaluation, Audio Evaluation, or Transcription Testing.

Benefits

• Freelance work with flexible hours (10+ hours per week)
• Rate of 19 USD/hour