Legal AI Evaluation Specialist @Aston Carter
Legal
Salary usd 45,000 - 60..
Remote Location
Employment Type contract
Posted YDay

[Hiring] Legal AI Evaluation Specialist @Aston Carter

YDay - Aston Carter is hiring a remote Legal AI Evaluation Specialist. πŸ’Έ Salary: usd 45,000 - 60,000 per year πŸ“Location: USA, UK, Canada

Role Description

We are seeking legal professionals to help evaluate the performance of advanced AI systems on real-world legal tasks. In this role, you will create realistic legal scenarios, assess AI-generated work products, and provide detailed feedback to improve the accuracy, reasoning, and quality of AI-generated legal analysis.

  • Develop realistic legal tasks based on professional experience in litigation, corporate law, compliance, intellectual property, employment law, real estate, or other legal practice areas.
  • Create supporting materials such as contracts, pleadings, correspondence, policies, fact patterns, exhibits, and legal memoranda.
  • Evaluate AI-generated deliverables, including legal analyses, contract redlines, research memos, brief sections, and issue-spotting exercises.
  • Compare multiple AI responses and assess their accuracy, completeness, legal reasoning, and practical usefulness.
  • Create detailed grading rubrics that define successful outcomes, required legal authorities, key issues, risk assessments, and appropriate recommendations.
  • Identify and document errors, including missed legal issues, unsupported conclusions, fabricated authorities, incorrect legal standards, and contract provisions that were overlooked.
  • Collaborate with other legal subject matter experts to review and improve evaluation tasks.

Qualifications

  • 2+ years of hands-on legal experience in a law firm, corporate legal department, government agency, compliance function, or related legal role.
  • Strong legal research, analysis, and drafting skills.
  • Excellent written communication with the ability to explain complex legal reasoning clearly and concisely.
  • Professional or native-level English proficiency.
  • Ability to critically evaluate legal work product and provide evidence-based feedback.
  • Familiarity with AI tools such as ChatGPT, Claude, Gemini, or similar technologies.
  • Strong attention to detail and ability to work independently.

Requirements

  • Bachelor's degree (completed or in progress) required.
  • JD, LLB, or equivalent law degree preferred.
  • Experience in one or more of the following areas:
    • Litigation (Civil, Commercial, Employment, or Administrative)
    • Corporate & Transactional Law
    • Mergers & Acquisitions
    • Commercial Contract Review
    • Compliance & Regulatory Affairs
    • Intellectual Property
    • Employment Law
    • Real Estate Law
    • Tax Law
    • Legal Operations
  • Bar admission is valued but not required.
  • Experienced paralegals and legal analysts with substantial drafting responsibilities are encouraged to apply.

Benefits

  • Remote contract opportunity.
  • Flexible schedule with a minimum availability of 10 hours per week.
  • No maximum weekly hour requirement; full-time hours may be available.
  • Competitive hourly compensation based on legal experience and subject matter expertise.
  • Independent contractor paid through PayPal. No benefits offered.

Application Deadline

This position is anticipated to close on Nov 30, 2026.

Workplace Type

This is a fully remote position.

Before You Apply
️
remote Be aware of the location restriction for this remote position: USA, UK, Canada
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Legal AI Evaluation Specialist @Aston Carter
Legal
Salary usd 45,000 - 60..
Remote Location
Employment Type contract
Posted YDay
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 135,000+ Remote Jobs
️
remote Be aware of the location restriction for this remote position: USA, UK, Canada
β€Ό Beware of scams! When applying for jobs, you should NEVER have to pay anything. Learn more.
Apply for this position
Did not apply βœ“
Applied βœ“
Sent Follow-Up βœ“
Interview Scheduled βœ“
Interview Completed βœ“
Offer Accepted βœ“
Offer Declined βœ“
Application Denied βœ“
Unlock 135,000+ Remote Jobs
Γ—
Apply to the best remote jobs
before everyone else

Access 135,000+ vetted remote jobs and get daily alerts.

4.9 β˜…β˜…β˜…β˜…β˜… from 500+ reviews

⚑ 139,490+ remote jobs, refreshed hourly

πŸ”” Real-time alerts: Apply first, direct to employer

πŸ›‘οΈ Vetted companies, no scams, true remote only

Unlock All Jobs Now

Maybe later