[Hiring] General Physician (AI Evaluation) @Gramian Consulting Group

Role Description

We are looking for licensed physicians currently practicing in the United States to support the evaluation and improvement of advanced AI systems in healthcare. The role involves:

• Reviewing AI-generated clinical content for medical accuracy, safety, completeness, and relevance, including diagnoses, treatment plans, summaries, and other case-based outputs.
• Applying real-world clinical judgment to identify errors, unsafe recommendations, missing information, and weak reasoning.
• Helping improve the quality and reliability of medical AI systems.

CONTRACT: Contractor assignment, 12 weeks

COMMITMENT: Part-time or Full-time (20-40h/week)

LOCATIONS: Remote - USA

PROCESS: The selection will be made based on an online questionnaire and resume/education/certification

NOTES: Candidates must be fully licensed and actively practicing medicine in the US.

Qualifications

• Medical Doctor (MD) or equivalent medical qualification such as MBBS, MBChB, or equivalent.
• Fully licensed to practice medicine in the United States.
• Currently actively practicing medicine in the US.
• At least 1 year of post-residency clinical practice experience as a physician.
• Strong general clinical judgment; no specific specialty is required.

Requirements

• Review AI-generated medical content for accuracy, safety, and completeness.
• Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning.
• Identify inaccurate, unsafe, misleading, or incomplete medical outputs.
• Apply evidence-based medical standards and professional clinical judgment.
• Provide structured expert feedback to improve model quality.
• Follow detailed evaluation and annotation guidelines.
• Complete structured questionnaires and reviews using web-based tools.
• Collaborate with clinical and AI teams on quality improvement.