[Hiring] Bilingual Internet Evaluator - French @Mercor

Role Description

Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity in French and English.

• Analyse content from French- and English-speaking online communities to identify errors involving slang, memes, cultural references, sarcasm, and code-switching.
• Build evaluation rubrics for bilingual internet communication and define expectations for culturally appropriate and platform-native language.
• Test language models using real-world bilingual prompts and provide detailed feedback to improve performance.
• Participate in QA reviews and benchmark creation to ensure consistency across evaluators and datasets.

Qualifications

• Native or near-native fluency in French and professional fluency in English.
• Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.
• Active participation in internet culture across both languages.
• Strong writing, analytical, and critical thinking skills.
• Available to commit 10–20 hours per week.

Requirements

• Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.
• Familiarity with differences between European French, Québec French, and other French varieties.
• Experience evaluating online content and internet-native communication.
• Interest in AI and multilingual language technologies.

Benefits

• Compensation: $50/hour
• Location: Remote
• Commitment: 10–20 hours/week

Application Process

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check: Interview Process
• For any help or support, reach out to: [email protected]
• Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.