[Hiring] Data Analysis Expert @Mercor

Role Description

• Write analysis problems from shipped work, including data, questions, constraints, and reference answers for model grading.
• Grade model-written analysis and pipelines for query accuracy, join effectiveness, and metric validity.
• Flag technically valid model results that may mislead decision-makers due to selection effects, leakage, or inappropriate metrics.
• Work independently and asynchronously to meet deadlines while improving AI model performance.
• Collaborate with subject matter experts to ensure consistency, relevance, and coverage across datasets.

Qualifications

• Professional experience in analytics, data engineering, statistics, or machine learning.
• Clear written communication skills for explaining reasoning.
• Comfort with ambiguous tasks and willingness to flag unclear instructions.

Company Description

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.