[Hiring] Quality Operations Lead @Careerflow.ai

Role Description

Manage day-to-day quality operations for multimodal AI annotation projects. Reporting to the Quality Manager, you will lead QA teams, monitor quality performance, resolve issues quickly, and ensure deliverables meet client standards within tight turnaround times.

Key Responsibilities

• Lead Senior QA Leads and QA Leads across shifts.
• Set review priorities, sampling plans, and quality coverage.
• Implement audits, scoring rubrics, and calibration processes.
• Track accuracy, agreement, error rates, review throughput, and turnaround time.
• Identify root causes and drive corrective actions with Team Leads.
• Resolve guideline-related questions and document decisions.
• Share quality insights after each delivery.
• Report quality performance to the Quality Manager.
• Support client reviews and quality-based incentive programs.

Qualifications

• 5–7 years of overall experience, including 2–3 years leading QA or quality operations teams.
• Strong knowledge of sampling, auditing, calibration, and root-cause analysis.
• Excellent attention to detail and ability to identify systemic issues.
• Strong communication and stakeholder-management skills.
• Experience in annotation, data labeling, or AI training data projects is preferred.

Requirements

• This is a project-based role involving a defined number of evaluation tasks.
• Each task will involve comparing multiple chatbots and providing a final assessment.
• Work Schedule: Five working days per week, including weekends as required, with two weekdays off.
• Work Hours - 7am-4pm PST.
• Duration: 16 weeks.