Role Description
We are seeking legal professionals to help evaluate the performance of advanced AI systems on real-world legal tasks. In this role, you will create realistic legal scenarios, assess AI-generated work products, and provide detailed feedback to improve the accuracy, reasoning, and quality of AI-generated legal analysis.
-
Develop realistic legal tasks based on professional experience in litigation, corporate law, compliance, intellectual property, employment law, real estate, or other legal practice areas.
-
Create supporting materials such as contracts, pleadings, correspondence, policies, fact patterns, exhibits, and legal memoranda.
-
Evaluate AI-generated deliverables, including legal analyses, contract redlines, research memos, brief sections, and issue-spotting exercises.
-
Compare multiple AI responses and assess their accuracy, completeness, legal reasoning, and practical usefulness.
-
Create detailed grading rubrics that define successful outcomes, required legal authorities, key issues, risk assessments, and appropriate recommendations.
-
Identify and document errors, including missed legal issues, unsupported conclusions, fabricated authorities, incorrect legal standards, and contract provisions that were overlooked.
-
Collaborate with other legal subject matter experts to review and improve evaluation tasks.
Qualifications
-
2+ years of hands-on legal experience in a law firm, corporate legal department, government agency, compliance function, or related legal role.
-
Strong legal research, analysis, and drafting skills.
-
Excellent written communication with the ability to explain complex legal reasoning clearly and concisely.
-
Professional or native-level English proficiency.
-
Ability to critically evaluate legal work product and provide evidence-based feedback.
-
Familiarity with AI tools such as ChatGPT, Claude, Gemini, or similar technologies.
-
Strong attention to detail and ability to work independently.
Requirements
-
Bachelor's degree (completed or in progress) required.
-
JD, LLB, or equivalent law degree preferred.
-
Experience in one or more of the following areas:
-
Litigation (Civil, Commercial, Employment, or Administrative)
-
Corporate & Transactional Law
-
Mergers & Acquisitions
-
Commercial Contract Review
-
Compliance & Regulatory Affairs
-
Intellectual Property
-
Employment Law
-
Real Estate Law
-
Tax Law
-
Legal Operations
-
Bar admission is valued but not required.
-
Experienced paralegals and legal analysts with substantial drafting responsibilities are encouraged to apply.
Benefits
-
Remote contract opportunity.
-
Flexible schedule with a minimum availability of 10 hours per week.
-
No maximum weekly hour requirement; full-time hours may be available.
-
Competitive hourly compensation based on legal experience and subject matter expertise.
-
Independent contractor paid through PayPal. No benefits offered.
Application Deadline
This position is anticipated to close on Nov 30, 2026.
Workplace Type
This is a fully remote position.