[Hiring] US Legal Expert - Benchmarking @Mercor

Role Description

• Evaluate the accuracy and depth of AI-generated legal content to strengthen reasoning and rigor in model outputs.
• Review complex legal documents for alignment with domain principles and methodologies.
• Provide clear, structured feedback to AI research teams to improve training data quality and downstream performance.
• Develop evaluation rubrics and benchmarks for assessing AI-generated legal tasks and solutions.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.
• Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

• Law degree or equivalent.
• Experience with AI model evaluation in legal contexts.
• Strong understanding of US legal systems.

Company Description

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.