[Hiring] AI Session Annotator @Mercor

Role Description

The AI Session Annotator (Hindi) will be responsible for the following:

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses to visible video content, identifying hallucinated or fabricated details.
• Score sessions on visual interpretation, accuracy, relevance, and response timing, focusing on spatial and directional language.
• Evaluate if the assistant appropriately warned users about potential health, safety, or financial risks.
• Write detailed comments supporting each score with concrete session evidence.
• Document conversation turns in the intake form.

Qualifications

• Must-Have:
• Native or native-level Hindi, spoken and written.
• Clear, precise written Hindi.
• An Android phone with a working camera and microphone.
• Attention to detail and consistent rubric application.
• Professional English reading comprehension.
• Preferred:
• Experience in data annotation, linguistic QA, content moderation, or AI model evaluation.
• Training in linguistics, translation, or interpreting.
• Ability to recognize unnatural or non-native Hindi.

Requirements

• Start Date: Immediate.
• High volume of work expected between 26 to 31 Aug.

Application Process

• Submit your resume or relevant background.
• Complete a short calibration task on sample sessions, assessed on scoring consistency and comment usefulness.

Resources & Support

• For details about the interview process and platform information, please check: Mercor Talent Docs
• For any help or support, reach out to: [email protected]
• Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.