[Hiring] Healthcare Artificial Intelligence Evaluation and Risk Assessment Specialist @Tunnell Government Services

Role Description

The Healthcare AI Evaluation and Risk Assessment Specialist provides scientific, technical, and regulatory expertise supporting FDA's oversight of AI-enabled medical devices. The incumbent serves as a subject matter expert in the evaluation of emerging healthcare AI technologies, including:

• Generative AI
• Large language models (LLMs)
• Foundation models
• Multimodal AI systems
• Agentic AI

The position focuses on evaluating safety, effectiveness, performance, reliability, risk management, and evidence supporting AI-enabled medical devices and contributing to regulatory science, policy development, and review best practices.

Major Duties and Responsibilities

• Review premarket submissions, IDE applications, and other regulatory submissions involving AI-enabled medical devices.
• Evaluate AI model performance, validation strategies, benchmarking methodologies, and supporting evidence for safety and effectiveness.
• Assess AI risk assessment and risk management approaches, including model failure modes, hallucinations, bias, automation bias, cybersecurity risks, human factors, post-market monitoring, and lifecycle management.
• Evaluate model testing approaches, including benchmarking, robustness testing, subgroup analyses, uncertainty quantification, stress testing, and adversarial testing (red teaming).
• Identify scientific limitations of proposed evaluation designs, datasets, scoring methodologies, and validation approaches.
• Assess evidence from clinical studies, reader studies, simulation-based evaluations, real-world evidence, and external validation studies.
• Provide scientific consultation to multidisciplinary review teams on AI evaluation methodologies, evidence generation, transparency, explainability, governance, and performance monitoring.
• Collaborate with FDA staff, other Federal agencies, academic institutions, healthcare organizations, standards development organizations, and industry stakeholders.
• Contribute to the development of regulatory science, policy, guidance documents, review methodologies, and best practices related to healthcare AI and emerging digital health technologies.
• Monitor advances in AI technologies and identify scientific challenges and opportunities relevant to FDA's regulatory mission.
• Prepare technical reports, scientific reviews, briefing materials, presentations, and policy analyses.

Qualifications

• Master's degree or higher in artificial intelligence, machine learning, computer science, data science, biomedical engineering, health informatics, medicine, public health, or a related field.
• At least seven (7) years of relevant experience in healthcare AI, medical devices, digital health, regulatory science, or related disciplines.
• Demonstrated expertise in AI evaluation, risk assessment, evidence generation, and performance assessment methodologies.

Preferred Qualifications

• PhD, MD, DVM, PharmD, or other advanced scientific degree.
• Experience supporting FDA or other Federal healthcare agencies.
• Knowledge of:
• Generative AI and LLMs
• Foundation and multimodal models
• Software as a Medical Device (SaMD)
• Medical device regulatory pathways (510(k), De Novo, PMA, IDE)
• AI governance and Good Machine Learning Practice (GMLP)
• Medical device cybersecurity and real-world evidence

Requirements

• Must be a US Citizen or Full Green Card holder.

Company Description

Tunnell strives to hire and retain the most qualified talent. We believe that having employees with different backgrounds and capabilities contributes to the success of our business. To attract qualified applicants, Tunnell posts to a wide variety of job sites. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Please be advised that certain client contracts may outline specific requirements for onsite work. Tunnell employees and/or contractors are expected to comply with all client requirements, including any safety and health protocols.