[Hiring] Quality Lead @Careerflow.ai

Role Description

Lead QA reviewers to ensure annotated data is accurate, consistent, and delivered on time. The role involves managing review queues, identifying errors, providing feedback, and supporting annotators in a fast-paced environment with tight turnaround times.

Key Responsibilities

• Lead QA reviewers and manage audit and review queues.
• Spot-check annotated data and reviewer decisions.
• Provide clear, actionable, and consistent feedback.
• Conduct office hours and clarify guidelines for annotators.
• Track quality scores, error trends, and reviewer performance.
• Train new reviewers on guidelines, tools, and review processes.
• Escalate recurring issues and unclear guidelines to the Senior QA Lead.

Qualifications

• 3–5 years of overall experience, including 1+ year leading or mentoring reviewers.
• Strong attention to detail and ability to follow complex guidelines.
• Clear communication and feedback skills.
• Experience in QA, annotation, data labeling, or AI training data is preferred.

Requirements

• This is a project-based role involving a defined number of evaluation tasks.
• Each task will involve comparing multiple chatbots and providing a final assessment.
• Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
• Work Hours - 7am-4pm PST.
• Duration: 16 weeks.