[Hiring] Mental Health Contractor @Flagship Pioneering, Inc.

Role Description

We’re seeking a mental health professional to help shape how AI systems understand and respond to vulnerable users. This is a flexible, part-time contract role working at the intersection of clinical expertise and AI development, with a focus on ensuring systems are safe, reliable, and impactful. You’ll collaborate with researchers, engineers, and product teams on high-impact initiatives involving evaluation, safety, and training of large language models (LLMs).

• Type: Contract (hourly, as-needed)
• Duration: 6 months with possibility to extend
• Hours: Typically 5–15 hours/week
• Schedule: Largely asynchronous, with occasional standing meetings during business hours
• Location: Remote

Responsibilities

• Evaluate AI Outputs: Assess responses for quality and safety
• Data Annotation: Review and label conversations or datasets using structured guidelines
• Develop Rubrics & Frameworks: Create evaluation criteria and scoring guidelines
• Red Teaming & QA: Identify model failures
• Scenario Design: Develop realistic conversations to test model performance
• Expert Feedback: Partner with cross-functional teams to iteratively improve system behavior, advise on safety and other quality standards

Qualifications

• Graduate-level training in a relevant field (e.g., psychology, psychiatry, social work, counseling, or related)
• Meaningful clinical experience across a range of mental health presentations
• Strong grounding in risk assessment, clinical decision-making, and ethics
• Comfort engaging with sensitive or ambiguous content
• Excellent written communication and attention to detail
• Familiarity with AI systems or large language models (LLMs)

Preferred Qualifications

• Licensure
• Experience with severe or complex mental health conditions, couples, and/or families
• Background in data annotation/labeling, content review, or structured evaluation workflows
• Experience developing rubrics, guidelines, or clinical frameworks
• Experience with trust & safety, policy development, or QA processes

Benefits

• Healthcare coverage
• Annual incentive program
• Retirement benefits
• A broad range of other benefits