[Hiring] Legal & Compliance Specialist @Xperteez Technology

Role Description

In this hourly, remote contractor role, you will work as a Legal & Compliance Subject Matter Expert to:

• Create challenging professional questions.
• Evaluate AI-generated legal and regulatory content.
• Design high-quality rubrics defining what a complete, well-reasoned, and professionally appropriate response should contain.

You will develop tasks involving:

• Legal analysis
• Regulatory interpretation
• Compliance
• Issue spotting
• Risk assessment
• Policy interpretation
• Contracts
• Privacy
• Financial regulation
• Employment matters
• Corporate compliance
• Related fields depending on your specialization

You will evaluate whether AI-generated responses:

• Identify relevant issues
• Apply appropriate rules or standards
• Recognize exceptions
• Distinguish facts from assumptions
• Address relevant risks
• Avoid unsupported conclusions

A major component of this role is rubric writing and evaluation design. You will:

• Translate nuanced legal or regulatory judgment into structured criteria covering:
• Issue identification
• Applicable standards
• Analysis quality
• Completeness
• Exceptions
• Jurisdictional considerations
• Risk
• Professional reasoning

This role is a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your expertise directly helps improve the world’s premier AI models by making their legal and compliance outputs more accurate, rigorous, and professionally reliable.

Qualifications

• JD, LLB, LLM, law degree, compliance qualification, or equivalent professional background relevant to the stated specialty.
• Professional legal qualification or bar admission is strongly preferred for attorney-focused roles.
• Strong professional proficiency in English, minimum C1.
• 3+ years of professional experience in law, regulatory compliance, legal research, policy, risk, privacy, financial compliance, contracts, or a related field.
• Demonstrated expertise in a clearly defined legal, regulatory, or compliance domain.
• Ability to create challenging professional scenarios requiring issue spotting, interpretation, analysis, and judgment.
• Strong ability to design rubrics defining required issues, applicable standards, reasoning steps, relevant exceptions, risks, and critical omissions.
• Ability to distinguish between legitimate alternative legal interpretations and objectively deficient analysis.
• Comfortable reviewing and critiquing rubrics developed by other legal or compliance experts.
• Strong attention to detail when evaluating terminology, factual assumptions, jurisdiction, authority, exceptions, materiality, and conclusions.
• Experience with legal education, examination writing, peer review, legal editing, quality assurance, policy drafting, compliance testing, or supervisory review is strongly preferred.
• Prior experience with AI evaluation, legal AI, data annotation, RLHF, model benchmarking, or rubric-based scoring is preferred.

Key Responsibilities

• Create legal and compliance tasks: Develop realistic, difficult scenarios requiring expert analysis and professional judgment.
• Design detailed rubrics: Define relevant issues, rules, standards, analytical steps, exceptions, risks, and critical errors.
• Evaluate AI-generated analysis: Assess responses for accuracy, completeness, reasoning quality, relevance, and professional rigor.
• Review issue spotting: Determine whether the model identifies the material legal or regulatory considerations.
• Assess reasoning quality: Identify unsupported conclusions, incorrect application of rules, missing exceptions, and faulty assumptions.
• Critique peer rubrics: Review rubrics for missing issues, ambiguity, redundancy, excessive subjectivity, or inaccurate legal expectations.
• Develop reference content: Create high-quality analyses, answer frameworks, critiques, and gold-standard examples.
• Support AI training: Produce questions, rubrics, evaluations, preference data, and reference-answer pairs for RL and SFT workflows.
• Maintain professional quality: Ensure content appropriately distinguishes factual analysis, legal interpretation, professional judgment, and uncertainty.