[Hiring] AI Domain Expert @24-MAG

Role Description

We are sharing a specialised part-time consulting opportunity for experienced professionals across Software Engineering, Finance, Data Science, Legal, and related expert domains to contribute to an advanced AI training and evaluation project focused on reasoning quality, prompt design, data annotation, written feedback, and model-output assessment. Selected professionals will review AI-generated outputs, design challenging domain-specific prompts, annotate data, conduct quality reviews, and provide structured feedback to improve model accuracy, reasoning, and reliability. No prior experience in AI is required.

Key Responsibilities

• AI Evaluation & Domain Analysis
  • Review AI-generated responses for accuracy, logic, relevance, and professional quality
  • Identify factual errors, weak reasoning, unsupported conclusions, or missing context
  • Apply domain expertise to complex or ambiguous scenarios
  • Distinguish substantive errors from acceptable alternative interpretations
  • Provide structured feedback supporting model improvement
• Prompt Design & Data Annotation
  • Design realistic domain-specific prompts that test reasoning and subject-matter understanding
  • Refine prompts for clarity, difficulty, and evaluation value
  • Annotate and classify data according to project guidelines
  • Identify edge cases requiring deeper interpretation
  • Support development of reliable training and evaluation datasets
• Quality Review & Professional Writing
  • Review AI outputs, annotations, and evaluation materials for consistency and quality
  • Support calibration across contributors and project standards
  • Produce clear, concise, and constructive written feedback
  • Edit responses for precision, structure, and readability
  • Collaborate asynchronously with project teams and other subject-matter experts

Qualifications

• 3+ years of professional experience in Software Engineering, Finance, Data Science, Legal, or another relevant expert domain
• Strong subject-matter expertise within the applicant's professional field
• Demonstrated critical-thinking and analytical skills
• Exceptional written English and professional-writing ability
• Experience producing high-quality materials such as technical documentation, investment memos, legal memoranda, research papers, or strategy presentations
• Experience reviewing or critiquing complex professional work
• Strong attention to detail and ability to articulate nuanced feedback clearly
• Comfortable working independently in a remote environment
• Experience with data annotation, prompt engineering, or AI-output evaluation is advantageous
• Background in technology, consulting, finance, law, research, or rigorous academic environments is valuable but not required
• No prior AI-training experience is required

Engagement Details

• Part-time independent contractor engagement
• Fully remote
• Compensation: $140–$200/hour
• Work will involve AI-output evaluation, prompt design, data annotation, quality assurance, professional writing, domain analysis, and structured feedback
• Assignments may vary depending on the contributor's professional domain
• Collaboration will occur remotely with project leads and other subject-matter experts
• Prior experience with prompt engineering, annotation, or AI evaluation is helpful but not required
• Project scope, workload, domain focus, and evaluation standards may evolve depending on project requirements
• Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party