Role Description
We are seeking experienced in-house legal counsel based in France to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving French law.
As an expert reviewer, you will:
-
Run identical legal prompts across two AI/LLM platforms.
-
Review and compare AI-generated legal responses side by side.
-
Evaluate responses against a standardized assessment rubric.
-
Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
-
Identify material differences, omissions, inconsistencies, or inaccuracies between responses.
-
Provide concise, clear, and well-supported written feedback for each evaluation.
-
Apply the evaluation criteria consistently and objectively across all assigned tasks.
-
Complete assignments independently while adhering to project guidelines and deadlines.
Qualifications
-
5+ years of experience as in-house legal counsel practicing in France.
-
Strong command of French law, particularly commercial and contract law.
-
Practical experience advising businesses on legal matters and evaluating real-world legal risk.
-
Excellent attention to detail and strong analytical judgment.
-
Exceptional written communication skills, with the ability to explain legal conclusions clearly and concisely.
-
Comfortable reviewing AI-generated content and distinguishing legally sound analysis from plausible but incorrect reasoning.
-
Ability to work independently, follow structured evaluation rubrics, and meet established deadlines.
-
Professional proficiency in written English is preferred for working with project instructions and evaluation materials.
Requirements
-
Initial Commitment: Approximately 10 hours.
-
Potential: Strong opportunity for additional work based on project requirements and performance.
-
Work Arrangement: Fully remote.
-
Confidentiality: All project work is subject to applicable confidentiality requirements and NDA obligations.
-
Engagement Type: Independent contractor.
Benefits
-
The engagement is fully remote and can be completed on a flexible schedule.
-
Projects may be extended, shortened, or concluded early depending on project needs and performance.
-
Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
-
Payments are made weekly based on services rendered through supported payment platforms.
-
H-1B and STEM OPT candidates are not eligible for this opportunity at this time.