[Hiring] Retail SME - AI Evaluation Expert @Mercor

Role Description

Guide research and engineering teams to close knowledge gaps in retail merchandising, category management, and operations reasoning.

• Design challenging, domain-relevant retail tasks and write accurate, well-reasoned solutions grounded in real retail practice.
• Evaluate AI model outputs against structured rubrics and provide clear, written feedback on correctness, judgment, and reasoning quality.
• Develop and refine evaluation guidelines and scoring rubrics specific to retail tasks.
• Collaborate with other subject matter experts to ensure consistency and accuracy in training data.

Qualifications

• 8+ years of dedicated professional experience in retail (e.g., merchandising, category management, retail operations, buying/planning) at a recognized, top-tier organization (e.g., Amazon, Walmart, Target, Nike, Costco, Home Depot, or equivalent).
• Prior hands-on experience evaluating LLM/AI model outputs against rubrics or structured scoring criteria — mandatory; please describe this experience in your application.
• Demonstrable career progression (e.g., Category Manager → Senior Manager → Director of Merchandising).
• Ability to engage reliably for at least 35 hours/week during weekdays.
• Verbal and written communication skills, problem-solving skills, and interpersonal skills.

Requirements

• W-2 employment with Cincinnatus LLC.

Benefits

• Compensation: $60–$80/hour.
• Location: Remote.

Application Process

• Upload resume.
• AI interview based on your resume.
• Submit form.

Resources & Support

• For details about the interview process and platform information, please check: Interview Process .
• For any help or support, reach out to: [email protected] .