[Hiring] Biomedical Subject Matter Expert @Mind Moves

Role Description

The Biomedical Subject Matter Expert (SME) serves as a senior scientific advisor and technical authority to provide expert guidance on evaluation framework development, benchmark dataset validation, and scientific review. The Biomedical SME contributes meaningfully to shaping the scientific integrity and rigor of challenge-related tasks.

Key Responsibilities

• Map dbGaP variables to controlled vocabularies and common data elements, including PhenX measurement protocols, using the dbGaP data dictionary's VARIABLE_SOURCE and SOURCE_VARIABLE_ID fields, and classify mappings by confidence level (e.g., identical, comparable, or related) consistent with dbGaP/PhenX conventions.
• Curate and validate semantic annotations linking dbGaP variables to standard terminologies such as the UMLS Metathesaurus, LOINC, and UMLS Concept Unique Identifiers (CUIs), following the approach used by groups like NLM's Lister Hill Center, Medical Data Models, and NHLBI's TOPMed program.
• Support FHIR-based interoperability by ensuring annotated vocabularies are correctly represented in the dbGaP FHIR schema and accessible via the dbGaP FHIR API.
• Design and curate the expert-adjudicated reference ("gold standard") mapping set against which Track 1 participant submissions are scored, including explicit criteria for the ONT_NONE discard class (variables with no valid target-vocabulary concept).
• Author and maintain annotation guidelines and adjudication protocols so reference-set decisions are reproducible and defensible under review or challenge.
• Run or oversee inter-annotator agreement checks across SME reviewers and resolve disagreements before a mapping enters the reference set.
• Advise on Track 2 relevance judgments — labeling dbGaP studies as relevant/not relevant to natural-language research queries — in a form suitable for computing ranking metrics.
• Contribute to held-out or adversarial "probe" cases used to detect memorized or hardcoded submissions during anti-gaming review.

Qualifications

• Advanced degree (MS or PhD preferred) in bioinformatics, biomedical informatics, epidemiology, genetics, library/information science, or a related field — or equivalent professional experience.
• Demonstrated experience with biomedical controlled vocabularies and terminology standards (e.g., UMLS, LOINC, MeSH, PhenX, or OBO Foundry ontologies such as HPO or OBI).
• Familiarity with clinical/genomic data repositories and data-sharing models comparable to dbGaP (e.g., NIH CDE Repository, TOPMed, other GWAS/genomic consortia).
• Experience with semantic web or ontology tooling (e.g., OWL, RDF, Protégé).
• Experience with Python or R.
• Strong written communication skills for documenting mapping rationale.
• Working knowledge of information-retrieval and classification evaluation metrics used to grade automated systems (precision, recall, F1-score, NDCG) and how to translate expert judgment into a defensible ground-truth/reference dataset.

Preferred Qualifications

• Prior experience working directly with dbGaP data dictionaries, submission packets, or the dbGaP FHIR API.
• Experience with data-dictionary harmonization tools (e.g., D2Refine or similar).
• Familiarity with GWAS/genomic consortium data harmonization processes.
• Experience with FHIR resource modeling in a research-data or genomics context.
• Prior experience building or contributing to benchmark/gold-standard datasets for an evaluation campaign or shared task (e.g., TREC-style relevance judgments, NLP/IR bake-offs) and calibrating multiple annotators to a shared rubric.

Position Type

• Part-Time Contract (Independent Contractor)

Program

• NLM Biomedical AI Challenges Program

Period of Performance

• Sept 2026 – March 2027

Project Hours

• 500 – 600 total hours

Compensation

• $130-160/hr

Location

• Remote within the US

Interview Process

Priority deadline for application is September 18th, 2026, and we look to fill these roles as soon as possible. If interested, please submit your application today! We expect the process to include a short hiring exercise followed by 1 20-30 min interview for final candidates.