[Hiring] AI Data QA & Training Specialist @Ninja Partners LLC

Role Description

The AI Data QA & Training Specialist is responsible for supporting AI model training activities by reviewing, evaluating, and documenting interactions in a timely and professional manner.

• Evaluate, review, and label content or system responses for quality, accuracy, relevance, and adherence to guidelines, as required.
• Assist with tasks such as content evaluation, response rewriting, summarization, classification, or prompt review as part of AI training initiatives.
• Identify and flag hallucinations, factual inaccuracies, and safety/compliance violations.
• Perform relevance, ranking, and retrieval quality assessments.
• Score outputs against established standards and provide systematic feedback.
• Support feedback loops between operations and engineering teams.
• Respond promptly and professionally to inquiries via phone, email, or chat as needed.
• Provide accurate information about products and services.
• Follow-up and resolve issues in a timely and efficient manner.
• Properly and accurately document AI-related evaluations or annotations in the organization’s CRM or designated tools.
• Adhere to company policies and procedures.
• Meet or exceed performance targets for related KPIs.
• Continuously improve knowledge of products, services, and processes by participating in training programs and continuous learning modules.
• Collaborate with other departments as needed.
• Maintain a positive, empathetic, and professional attitude toward customers and colleagues at all times.
• Perform other duties as assigned.

Qualifications

• Previous customer service experience, data annotation or AI training/evaluation skills or equivalent.
• Good communication skills, both verbal and written.
• Proficient in using computers and various software applications.
• Knowledge and experience with a CRM preferred.

Benefits

• Competitive compensation.
• Adherence to government-mandated benefits.
• Retirement Savings Program with Company Matching.
• Life Insurance.
• HMO on day 1.
• Paid time off, birthday leave.
• Bonus and incentive plans.
• Opportunities for skills training and personal and professional development.
• Employee Referral Program.
• Beautiful office space (for onsite employees).
• Free lunch provided daily (for onsite employees).