[Hiring] Italian Evaluator Expert - AI Trainer @Mercor
Italian Evaluator Expert - AI Trainer @Mercor
Artificial Intelligence
Salary $25–$30/hour
Remote Location
Employment Type part-time
Posted 1wk ago

[Hiring] Italian Evaluator Expert - AI Trainer @Mercor

1wk ago - Mercor is hiring a remote Italian Evaluator Expert - AI Trainer. πŸ’Έ Salary: $25–$30/hour πŸ“Location: Italy, Switzerland

Role Description

The Bilingual Italian Generalist Evaluator Expert will be responsible for the following:

  • Author Italian/English prompt-golden answer pairs to train and evaluate advanced language models.
  • Create detailed prompts in Italian and/or English, ensuring natural phrasing and real-world relevance for Italian-speaking users in Switzerland and Italy contexts.
  • Establish high-level expectations for correct responses and develop comprehensive rubrics that account for linguistic nuance, tone, and cultural conventions specific to these regions.
  • Run prompts through models and assess preliminary outputs for accuracy, fluency, and cultural fit in Italian, comparing results against English where needed.
  • Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability across Italian-language benchmarks.

Qualifications

  • Native-level fluency in Italian (written), specific to Switzerland or Italy usage, with strong reading/writing ability in English.
  • Must be native to Switzerland or Italy and have lived in or spent significant time in-country, with deep cultural and linguistic familiarity.
  • BS or BA from a reputable institution (completed or in progress).
  • Strong writing and critical thinking skills.
  • Ability to work independently and meet deadlines.
  • Significant familiarity with ChatGPT or similar tools for personal decision-making, hobbies, or general interests.
  • Based in Switzerland or Italy (or able to reliably produce Switzerland- or Italy-specific, culturally accurate Italian).

Requirements

  • Experience in teaching, research, editing, or academic writing (preferred).
  • Experience creating evaluation criteria, rubrics, or grading guidelines (preferred).
  • Familiarity with LLMs, prompting, or model evaluation (preferred).

Benefits

  • Compensation: $25–$30/hour
  • Location: Remote
  • Duration: 2–4 months
  • Commitment: 20+ hours/week

Application Process

The application process takes 20–30 minutes to complete:

  • Complete an AI-led interview (about 15 minutes).
  • If approved, complete a paid assessment focused on writing and rubric creation.
  • If selected, you will be invited to work on the project.

Resources & Support

  • For details about the interview process and platform information, please check: Interview Process
  • For any help or support, reach out to: [email protected]
  • Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Before You Apply
️
remote Be aware of the location restriction for this remote position: Italy, Switzerland
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Italian Evaluator Expert - AI Trainer @Mercor
Artificial Intelligence
Salary $25–$30/hour
Remote Location
Employment Type part-time
Posted 1wk ago
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 165,000+ Remote Jobs
️
remote Be aware of the location restriction for this remote position: Italy, Switzerland
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 165,000+ Remote Jobs
Γ—

Apply to the best remote jobs
before everyone else

Access 165,000+ vetted remote jobs and get daily alerts.

4.9 β˜…β˜…β˜…β˜…β˜… from 500+ reviews
Unlock All Jobs Now

Maybe later