[Hiring] AI Language Quality Evaluator @Volga Partners

Role Description

We are seeking detail-oriented AI Language Quality Evaluator with fluency in Greek and English to evaluate the accuracy of AI models that detect localization and UI bugs across application screens. This is a freelance, task-based role designed for those seeking supplemental income. Tasks will be assigned as they become available, and work may be irregular or intermittent. Notifications will be sent via MS Teams, WhatsApp, email, or Slack (after onboarding through the client’s portal). All tasks are offered on a first-come, first-served basis, making this role ideal for individuals who are comfortable with flexible, on-demand work.

What You’ll Do:

• Review source and target text alongside AI‑flagged bug findings to assess accuracy.
• Determine whether identified issues represent genuine bugs and confirm the correctness of their category/type.
• Classify findings into categories such as correct, misclassified, partially correct, false positive, or missed.
• Verify flagged issues against screenshots to ensure accuracy in the visual UI context.
• Provide clear, evidence‑based error descriptions for valid bugs.
• Document explanations thoroughly and propose corrected translations where relevant.
• Maintain consistency, accuracy, and completeness across all evaluation datasets.

Qualifications

• Professional fluency in Greek and English with excellent reading comprehension and communication skills.
• Bachelor’s degree in Linguistics, Computer Science, Languages, or a related field; or equivalent professional experience.
• Degree or certification in Greek Language (required).
• Strong analytical and critical‑thinking skills with exceptional attention to detail.
• Ability to identify subtle linguistic issues, inconsistencies, and UI defects.
• Experience in annotation, evaluation, translation, localization, linguistics, or QA is helpful but not required — training and guidance will be provided.
• Preferred background in localization QA, translation review, data annotation, or AI evaluation.
• Comfortable working with spreadsheets, PDFs, screenshots, and structured datasets.
• Experience evaluating AI/LLM outputs is an advantage.
• Excellent logical reasoning and written communication skills for documenting evaluation decisions.
• Ability to distinguish genuine localization defects from acceptable language or product behavior.
• Strong organization and task‑management skills.
• Independent work style with the ability to maintain high accuracy and productivity while collaborating effectively with a global team.

Requirements

• Must have own device (laptop/desktop).
• Currently hiring for Freelance/Task-based (Ranging from 0 to 20 hours a week).
• Candidate must be available in IST (Preferred 8 AM IST onwards).
• Must have access to good Wi-Fi connection during working hours.
• This role is a 1099 independent contractor position (W-8 BEN form provided for non-U.S. candidates).

Compensation

• Compensation range: USD $7 – $9 per hour DOE.
• Hours are dependent on the volume of tasks assigned by the client.
• This is a supplemental income opportunity.

Important Notes

• No guaranteed minimum hours.
• No guaranteed end date.
• Tasks are offered on a first-come, first-served basis.
• Work availability may fluctuate depending on client demand.

Why This Role

• Opportunity to contribute to cutting‑edge AI language and localization projects.
• Flexible, remote, task‑based engagement ideal for supplemental income.
• Build practical experience in AI evaluation, bug classification, and linguistic QA.
• Work with global teams and QA leads, gaining exposure to international projects.
• Strengthen your professional profile in localization, AI, linguistics, and quality assurance.
• Independent contractor role with competitive hourly compensation ($7–$9 DOE).