[Hiring] Senior Psychometrician @NBME

Role Description

NBME®'s Psychometrics and Data Analysis (PADA) unit is seeking a Senior Psychometrician to join their team. Interested candidates when applying should include a cover letter to indicate their interest in and fit for that role. This position is expected to make contributions in six primary areas:

• Applied research and development in support of modifications to examination designs, and analysis methods and procedures.
• Planning and execution of psychometric analyses, scoring, and score reporting for operational examination programs.
• Contribute to the educational measurement community via professional presentations and publications related to independent and organizational research agendas.
• Evaluate existing procedures for improvement opportunities, identify new procedures to increase accuracy and efficiency of exam processing.
• Designing and evaluating data visualization and graphical representation of data for stakeholder feedback, examinee feedback reports, and interactive data tools.
• Supporting AI-related research initiatives.

Senior Psychometrician must effectively collaborate with a variety of internal staff including data analysts, test developers, information technologists, and program managers. In addition, external facing communication and engagement with clients and subject matter experts from a wide range of medical and health care fields is also necessary.

This role has been designated as primarily remote, meaning it requires little to no onsite attendance. While this role can be designated as remote, you are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We're open to considering candidates within 50 miles of our office location in Philadelphia, PA.

Please note that onsite interviews and onboarding at our Philadelphia office may be required for this role. If applicable, advance notice will be provided to support planning.

Qualifications

• Strong background in psychometric theory and application, including knowledge of IRT, CTT, statistics, test development procedures, and research design.
• Advanced knowledge of applied measurement topics, such as equating, scaling, generalizability theory, Bayesian methodology, and/or standard setting.
• Demonstrated strength in presenting assessment data graphically to facilitate user comprehension, support correct inferences, and guide subsequent actions.
• Knowledge and/or experience in natural language processing, process data analytic methods, formative assessment approaches is desirable.
• Excellent computer skills and a working knowledge of statistical software (e.g., Calibration software, SAS, Python, R).
• Excellent oral and written communication skills.
• Ability to identify errors and solve problems.
• Excellent interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds.

Requirements

• A minimum of 5 years of experience in a Psychometrician/Measurement Scientist role is required for consideration.
• Doctorate degree in Educational/Psychological Measurement, Statistics, or a related field is required.

Benefits

• Healthcare, Dental, Prescription, and Vision plans.
• 401(k) w/match.
• Tuition Reimbursement Plan.
• Commuter Benefit: Public Transit or Parking options.
• Remote Friendly Workplace.

Company Description

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators.

• We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine® Program and Item Writing Workshops.
• Together with the Federation of State Medical Boards, NBME develops and manages the United States Medical Licensing Examination®, which measures the ability to apply knowledge and skills that form the basis of safe and effective patient care.
• Our Competency-based Assessment unit is focused on new methods as well as the optimization of assessment in the workplace and education.
• NBME views diversity, equity and inclusion (DEI) as foundational and enduring to our strategy and vision.