[Hiring] Text Situated Alignment Specialist @Careerflow.ai

Role Description

We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research.

SMEs will:

• Review conversations between participants and AI models.
• Assess whether sufficient context was gathered before recommendations were made.
• Identify missed opportunities for clarification.
• Provide structured feedback to improve conversational quality.

Job Responsibilities:

• Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
• Identify missing context and recommend relevant follow-up questions.
• Evaluate whether additional information would have changed the AI's recommendations.
• Distinguish between critical ("load-bearing") and non-essential information.
• Conduct qualitative reviews and document findings using structured evaluation guidelines.
• Collaborate with research teams to ensure consistent, high-quality assessments.

Qualifications

• At least 3–5 years of direct practice relevant qualifications and professional experience in at least one of the following areas:
• Licensed Social Work
• Counseling, Therapy, or Psychology
• Qualitative Research, HCI, or Communication
• Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields

Requirements

• Must be based in the USA, Canada, or Western Europe.
• Experience eliciting relevant context when clients initially provide incomplete information.
• Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints.
• Qualitative coding or structured case review.
• Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative.
• Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering.

Benefits

• Project duration - 3 weeks (short term project).
• Project type - Pay-per-task (PPT).
• AHT - 75 minutes (approx.).
• Engagement - Full time.
• Estimated project start date - 1st October (estimated).

Company Description

Careerflow Human Data Labs partners with AI companies to bring real-world professional expertise into their products.