[Hiring] AI Safety Practitioner - Expert Evaluator @Mercor

Role Description

The AI Safety Practitioner will be responsible for:

• Evaluating AI-generated responses for safety, factual accuracy, policy compliance, and overall quality.
• Reviewing content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains.
• Applying and refining evaluation rubrics for RLHF, SFT, and AI safety benchmarking.
• Identifying unsafe outputs, hallucinations, reasoning failures, and policy violations.
• Providing structured feedback to improve model alignment and safety performance.
• Collaborating with AI researchers and safety teams on ongoing evaluation initiatives.

Qualifications

• Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline.
• 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field.
• Excellent written English, critical thinking, and analytical reasoning skills.
• Ability to consistently evaluate nuanced and policy-sensitive scenarios.

Requirements

• Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation.
• Familiarity with safety policies, content moderation, or evaluation rubric development.
• Experience reviewing complex, high-risk, or ambiguous content.

Benefits

• Compensation: $60–$70/hour
• Location: Remote

Application Process

• Upload resume
• AI interview based on your resume
• Submit form

For details about the interview process and platform information, please check: Interview Process

For any help or support, reach out to: [email protected]

Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.