[Hiring] Head of Quality, AI Data Operations @TaskUs

Role Description

As the Head of Quality, AI Data Operations, you will be responsible for ensuring that the quality of our training data, adversarial testing, and model evaluation services meets the highest standards. You will drive thought leadership on data quality, work closely with customers to define and deliver high-quality outputs, and oversee the development of training and quality protocols across projects. This role requires a blend of strategic thinking, hands-on operations, and cross-functional collaboration to ensure our services are impactful for AI and LLM projects.

• Lead the design and implementation of quality assurance protocols tailored to training data and model evaluation.
• Design and oversee specialized quality protocols for the collection and enrichment of multi-modal data specifically for advanced Robotics and Autonomous Vehicle (AV) clients.
• Master the "Human-in-the-Loop" for Hardware: Lead the quality strategy for remote operations support, ensuring that human intervention data used for robotaxi navigation and robotic limb coordination meets zero-compromise safety standards.
• Own the definition of what "high-quality" data means across diverse projects and ensure these standards are met across the organization.
• Drive thought leadership with customers, aligning on data quality goals, and developing innovative quality processes.
• Act as the primary point of contact for customer discussions related to data quality and model evaluation.
• Provide strategic guidance on handling edge cases, and offer solutions for the nuances and challenges involved in building high-quality training data.
• Lead external communication on data quality, positioning the company as a thought leader in AI model robustness and evaluation.
• Foster a high-performance culture, encouraging continuous learning and improvement.
• Continuously explore and implement new methodologies for improving the quality of training data and model evaluation processes.
• Drive a culture of testing, iterating, and scaling processes, ensuring that all workflows are efficient and results-driven.

Qualifications

• 7+ years of Data Quality leadership experience, ideally within an organization that provides HITL, RLHF and evaluation services to leading LLM developers, Mag7 companies, AV builders and Robotics companies.
• Deep understanding of how LLMs, Generative AI workflows, and multi-modal data structures (video, spatial, and sensor fusion) essential for the robotics ecosystem.
• Strong interest and commitment to learning about the latest developments in LLMs and AI technologies.
• Proven ability to design and lead quality assurance processes for data annotation and AI model evaluation.
• Experience developing scalable systems like "golden datasets" for evaluating contributor performance.
• Strong communication and leadership skills with the ability to engage effectively with customers, internal stakeholders, and global teams.
• Track record of managing teams in a high-velocity environment, with a focus on outcomes.
• Strong analytical skills with the ability to derive actionable insights from complex data.

Requirements

• Excited to tackle ambiguous problems with a relentless attitude of testing, iterating, and scaling solutions.

Benefits

• Competitive industry salaries and comprehensive benefits packages.
• Commitment to a People First culture reflected in various departments including Total Rewards, Wellness, HR, and Diversity.
• Inclusive environment and positive impact on the community.
• Encouragement of internal mobility and professional growth at all stages of an employee's career.

Location

• US - Remote
• Traveling - 25%

Salary Range

• $160,000 - $200,000 + bonus + equity plan

DEI

In TaskUs we believe that innovation and higher performance are brought by people from all walks of life. We welcome applicants of different backgrounds, demographics, and circumstances. Inclusive and equitable practices are our responsibility as a business. TaskUs is committed to providing equal access to opportunities. If you need reasonable accommodations in any part of the hiring process, please let us know.

EEO

TaskUs is proud to be an equal opportunity workplace and is an affirmative action employer. We celebrate and support diversity; we are committed to creating an inclusive environment for all employees. TaskUs people first culture thrives on it for the benefit of our employees, our clients, our services, and our community.

We invite you to explore all TaskUs career opportunities and apply through the provided URL https://www.taskus.com/careers/ .