[Hiring] Clinical Evaluator @Headway

Role Description

Headway is building AI powered tools for both patients and providers, and we are dedicated to ensuring that clinical experts are included throughout the process. As a Clinical Evaluator, you'll work with our Clinical and Product teams to refine evaluation rubrics that set the standards for what safe, clinically sound, high quality output looks like. You'll test our AI products against those standards to help decide when one is ready to launch. While the ultimate goal is a set of standards, building those standards is challenging – you'll frequently be asked to apply your clinical judgment flexibly and work through hard calls with your peer evaluators.

Qualifications

• Current licensed therapist or professional counselor with an independent, unrestricted license
• 3+ years of direct therapy experience
• Strong grasp of risk assessment, safety planning, and documentation standards
• Ability to notice quickly when an output could put a patient at risk
• Comfortable working alongside AI-assisted review tools
• Ability to explain clinical reasoning clearly in writing
• Willingness to adapt views based on peer or data input
• Enjoy working through ambiguous edge cases with peers
• Comfortable adapting to various healthcare technology platforms
• Experience with AI chart reviews, quality audits, or clinical documentation standards is a plus

Requirements

• Review output from AI tools across Headway's patient and provider products for clinical accuracy, safety, and appropriateness
• Apply evaluation rubrics and help improve them
• Document reasoning where a rubric falls short
• Participate in calibration sessions and inter-rater reliability rounds
• Work with the Clinical Product team to turn clinical feedback into specific rubric or output changes
• Take on other evaluation work as AI programs grow, such as labeling datasets and reviewing new product use cases before launch
• Complete all review and feedback work within Headway's designated systems, adhering to HIPAA and Headway's privacy and confidentiality requirements

Benefits

• Hourly rate of $125
• Minimum commitment of 10 hours per week
• Must set up or already have an LLC or S-Corp