[Hiring] QC Reviewer @Welo Data

Role Description

• Review completed annotations of robot manipulation videos across three levels of labeling detail (atomic motion, skill/subtask, task/goal).
• Cross-check annotator descriptions against all three camera views (overhead and both wrist-mounted cameras) to verify accuracy of described actions, object identification, and contact/grasp details.
• Verify full coverage of each video — confirm there are no gaps in labeling, including idle or pause moments.
• Check that descriptions accurately reflect what actually happened in the video, including failures, drops, or slipped grips — flagging any instances where outcomes were inaccurately described or "smoothed over."
• Evaluate annotations for adherence to the style guide: correct vocabulary usage, spatial/directional accuracy, consistent terminology for objects and actions, and appropriate language variation (avoiding repetitive phrasing).
• Identify recurring errors or patterns of confusion among annotators and report them to the team lead for calibration purposes.
• Provide specific, actionable feedback on rejected or revised annotations, referencing the style guide and reference examples.
• Participate in periodic calibration sessions with the team and client to align QC standards with evolving guidelines or edge-case resolutions.
• Maintain a QC log or tracking sheet documenting review outcomes, common error types, and annotator performance trends (as required by the project).

Qualifications

• Excellent written English and strong reading comprehension — you'll be evaluating precise, nuanced language choices, not just checking for typos.
• Exceptional attention to detail — able to catch subtle mismatches between video content and written description (e.g., a mislabeled grasp type, an incorrect object part, a missed failure event).

Requirements

• Prior experience in a QC, editing, proofreading, or annotation review role.
• Experience with video annotation, data labeling, or transcription QA specifically.
• Familiarity with robotics terminology (grippers, end-effectors, manipulation).
• Experience with annotation tools such as Label Studio, including review/approval workflows.