[Hiring] AI Session Annotator (Arabic) @Mercor

Role Description

The AI Session Annotator (Arabic) will be responsible for the following:

• Review recorded sessions where users interact with an AI assistant via voice and camera.
• Compare the assistant's responses with visible video content to identify hallucinated or fabricated details.
• Score sessions on visual interpretation, accuracy, relevance, and response timing, including spatial language use.
• Judge the appropriateness and timing of warnings related to health, safety, or financial security.
• Write detailed comments supporting each score with concrete evidence from sessions.
• Capture conversation turns in the intake form.

Qualifications

• Must-Have:
• Native or native-level Arabic, spoken and written.
• Clear, precise written Arabic.
• An Android phone with a working camera and microphone (mandatory for the project).
• Attention to detail and consistent rubric application.
• Professional English reading comprehension.
• Preferred:
• Experience in data annotation, linguistic QA, content moderation, or AI model evaluation.
• Training in linguistics, translation, or interpreting.
• Ability to recognize unnatural or non-native Arabic.

Requirements

• Start Date: Immediate; high volume of work between 26 to 31 Aug is expected.

Application Process

• Submit your resume or relevant background.
• Complete a short calibration task on sample sessions, assessed on scoring consistency and comment usefulness.

Resources & Support

• For details about the interview process and platform information, please check: Mercor Interview Process .
• For any help or support, reach out to: [email protected] .
• Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.