Role Description
Our client is seeking a Healthcare Operations Manager to play a crucial role in evaluating and validating AI models specifically designed for the healthcare domain. This individual will be responsible for testing AI prompt outputs, developing detailed grading rubrics, and ensuring that AI model performance meets complex healthcare standards, including terminology, documentation rules, and compliance. This fully remote position offers a flexible work schedule with no direct patient care, shift work, or on-call duties.
-
AI Model Evaluation & Rubric Creation: Test prompts on active AI models, analyze output accuracy, and build detailed grading rubrics to evaluate model performance against complex healthcare standards.
-
Domain Validation: Ensure AI models handle domain-specific terminology, documentation rules, compliance standards, and workflow logic safely and accurately.
-
Independent Execution: Work self-sufficiently using provided AI tools, detailed project instructions, and support resources.
Qualifications
-
Strong background in Healthcare Operations, Health Information Management (HIM), Revenue Cycle, or Payer/Health Plan Operations.
-
Exceptional grit, attention to detail, stamina for deep analytical work, and the ability to work independently without hands-on supervision.
-
Must possess your own reliable laptop/computer with high-speed internet access.
-
Experience in Medical Coding & Billing / Rev Cycle (e.g., Medical Coders, Coding Auditors, Clinical Documentation Improvement (CDI) Specialists, Revenue Cycle Analyst, RCM leaders).
-
AAPC or AHIMA credentials (e.g., CPC, CCS, CCA) are preferred, though strong practical experience is heavily valued.
-
Experience in HIM & Compliance (e.g., HIM Managers/Directors, Compliance Officers, or HIPAA Specialists).
-
Experience in Utilization & Care Management (e.g., Utilization Review (UR) Nurses or Case Managers).
-
Experience in Payer & Claims Operations (e.g., Claims Adjudicators, Credentialing Specialists, or Health Plan Operations staff).
-
Prior AI Experience: Experience with remote data annotation, LLM testing, or AI model evaluation platforms is a plus.
Requirements
-
This position involves zero direct patient care, shift work, or on-call duties.
-
Consistent availability to dedicate 10+ hours per week (with a minimum of 5+ hours per week) is required.
Schedule / Shift
-
Fully remote, flexible work.
-
Can work any hours and any days as long as candidate can commit to 5+ hours per week (ideally more).
Benefits
-
Paid Sick Leave (Medix provides paid sick leave according to state and local sick leave ordinances).
-
Health Benefits / Dental / Vision (Medix offers 6 different health plans: 3 Major Medical Plans, 2 Fixed Indemnity Plans (Standard and Preferred), and 1 Minimum Essential Coverage (MEC) Plan. Eligibility for health benefits is based on verifying that an average of 30 hours per week during the first 4 weeks of the work assignment has been met. If you meet eligibility requirements and take action to enroll, you will be covered no earlier than 60 days into your assignment, depending on plan selection(s)).
-
401k (Eligible on the first 401k open enrollment date following 6 consecutive months on assignment. 401k Open Enrollment dates are 1/1, 4/1, 7/1, and 10/1).
-
Short Term Disability Insurance.
-
Term Life Insurance Plan.