[Hiring] AI Conversation Evaluator @YO AI Labs

Role Description

We are seeking experienced paralegals to contribute their legal expertise to an AI training project. You will apply your practical knowledge of legal research, document review, citation verification, and document preparation to evaluate realistic legal tasks and improve AI systems. Prior AI experience is not required.

Key Responsibilities

• Complete legal tasks involving document review, research, citation verification, and document preparation.
• Explain the reasoning behind legal decisions and assessments.
• Follow established review protocols and flag cases that require further clarification.
• Identify ambiguous issues requiring attorney judgment.
• Review other contributors' work for accuracy and consistency.
• Deliver high-quality work within assigned deadlines.

Qualifications

• At least 5 years of hands-on paralegal experience in litigation, corporate, or regulatory practice.
• Practical experience in document review, legal research, and citation verification.
• Paralegal certificate, bachelor's degree, or equivalent professional experience.
• Ability to manage multiple documents and identify inconsistencies.
• Strong written and verbal English communication skills.
• Experience handling complex legal assignments with accuracy and attention to detail.

Preferred Qualifications

• Experience with legal data projects, e-discovery platforms, or structured review protocols.
• Familiarity with AI or LLM evaluation.
• Strong analytical, organizational, and problem-solving skills.

Requirements

• $40–$80 per hour.
• Approximately 10+ hours per week.
• Flexible weekly schedule.
• Remote contractor opportunity open worldwide to candidates with U.S. legal practice experience.

Selection Process

• Submit an application and complete screening questions.
• Complete a role-specific AI interview.
• Undergo profile review.
• Complete onboarding with the Talent Operations team.