Role Description
We are seeking board-certified psychiatrists to support an expert evaluation project with a leading AI research organization. The project focuses on assessing how effectively advanced AI systems reason through complex psychiatric scenarios. As a Psychiatry Expert, you will use your clinical expertise to:
-
Develop expert-level psychiatric cases and reasoning challenges designed to test advanced AI systems.
-
Create accurate, clinically rigorous, gold-standard answers supported by clear diagnostic and clinical reasoning.
-
Evaluate nuanced psychiatric scenarios, including complex differentials, edge cases, and risk-assessment considerations.
-
Review AI-generated responses and identify clinical inaccuracies, reasoning gaps, unsupported conclusions, and common failure patterns.
-
Provide structured feedback to help research teams understand and improve AI performance on advanced psychiatric tasks.
-
Collaborate directly with AI research teams and other subject-matter experts.
-
Apply current clinical knowledge and professional judgment consistently when evaluating model outputs.
Qualifications
-
Completed psychiatry residency through an ACGME, AOA, or recognized national-equivalent program. Current trainees do not qualify.
-
Medical degree: MD or DO. International medical degrees from recognized institutions are also eligible.
-
Active board certification in psychiatry, such as:
-
ABPN
-
FRCPC
-
MRCPsych
-
FRANZCP
-
Recognized national equivalent
-
Active, unrestricted medical license with no current suspension, revocation, or open disciplinary action.
-
3+ years of independent clinical practice after residency, either currently or within the past two years. Residency and fellowship training do not count toward this requirement.
-
Current or recent practice in an accredited or government-licensed clinical setting, including hospitals, academic medical centers, community clinics, private practices, or telehealth organizations.
-
Must be based in the United States, United Kingdom, Europe, or Australia. US-based candidates are preferred.
-
Psychiatry must be the primary area of professional practice.
Preferred Qualifications
-
10+ hours per week of direct patient care, currently.
-
Specialized expertise in one or more of the following areas:
-
Addiction Psychiatry
-
Child & Adolescent Psychiatry
-
Forensic Psychiatry
-
Geriatric Psychiatry
-
Consultation-Liaison Psychiatry
-
Subspecialty expertise demonstrated through a fellowship, subspecialty board certification, or at least two years of relevant clinical practice.
-
Experience developing or administering OSCEs, including examiner or assessment-development experience.
-
Current or recent faculty appointment within a psychiatry department.
-
Experience reviewing, evaluating, grading, or developing clinical or medical educational content.
Role Responsibilities
-
Develop clinically challenging psychiatric scenarios for AI evaluation.
-
Produce authoritative answers with transparent and well-structured clinical reasoning.
-
Focus on nuanced differentials, psychiatric risk assessment, diagnostic uncertainty, and clinical edge cases.
-
Evaluate model responses for clinical accuracy, reasoning quality, and appropriate judgment.
-
Identify recurring failure modes in AI reasoning and communicate them clearly to research teams.
-
Collaborate with other psychiatric and clinical experts to maintain consistent evaluation standards.
Screening Process
Qualified candidates will complete a 20β30 minute structured interview. The screening conversation will focus on your clinical background, independent practice experience, psychiatric specialization, and relevant subspecialty expertise.
Engagement Details
-
Role: Psychiatry Expert
-
Work Arrangement: Fully Remote
-
Engagement Type: Independent Contractor
-
Location Eligibility: US, UK, Europe, or Australia
-
Projects may be extended, shortened, or concluded based on project requirements and performance.
-
Payments are made weekly based on services rendered through available payment platforms.
-
The engagement does not require access to confidential or proprietary information belonging to any current or former employer, client, or institution.
-
H-1B and STEM OPT candidates are not currently supported.