[Hiring] Educator/Assessor Writer @YO AI Labs

Role Description

We are looking for Educator/Assessor Writers to support an AI evaluation project focused on assessing and improving AI-generated content. You will apply your expertise in education, assessment, academic writing, grading, and rubric-based evaluation to review written responses. No prior AI experience is required. This role is ideal for professionals experienced in:

• Evaluating written work
• Developing assessments
• Grading against rubrics
• Supporting academic writing

The engagement is fully remote and can be completed alongside other professional commitments.

Qualifications

• Native or near-native written fluency in English
• Degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand
• Experience grading, marking, or evaluating written work against established criteria or rubrics
• Background in assessment design, instructional design, academic writing, peer review, or thesis supervision
• Strong critical-analysis and written communication skills
• Excellent attention to detail and ability to make objective assessments
• Ability to work independently and meet project deadlines

Requirements

• Evaluate and compare AI-generated responses for clarity, accuracy, tone, helpfulness, and adherence to instructions
• Assess responses using provided rubrics, guidelines, and evaluation criteria
• Assign quality scores and provide clear, well-reasoned rationales
• Identify unsupported claims, inaccuracies, inconsistencies, and content gaps
• Evaluate whether responses are appropriate and practical for their intended audience
• Document evaluation decisions and observations accurately
• Collaborate asynchronously with project managers and reviewers using digital content review platforms
• Maintain consistency and objectivity across assigned evaluations

Preferred Skills

• Experience with AI model evaluation or data annotation
• Familiarity with RLHF or AI training workflows
• Experience using digital assessment or content review platforms
• Strong understanding of educational assessment and rubric design