[Hiring] Psychometrician @Universities of Wisconsin

Role Description

The Psychometrician position is located within WIDA’s Assessment Department and will report to the Psychometrics Manager. This position will be responsible for:

• Supporting the psychometric operational and research activities associated with WIDA’s language assessments.
• Monitoring and evaluating operational psychometric projects and analyses conducted by vendors.
• Authoring and reviewing research reports and psychometric deliverables.

The position will play a key role in supporting the psychometric operations and continuous improvement of the MODEL assessment program, including automated scoring initiatives. Additional responsibilities include:

• Conducting and reviewing test security analyses for ACCESS for ELLs.
• Supporting item bank maintenance and quality assurance activities.
• Providing psychometric quality control for ACCESS and Alternate ACCESS assessment programs.
• Contributing to operational and research projects that support the validity, reliability, and fairness of WIDA assessments.

Employees in this position can expect to receive benefits such as:

• Generous vacation, holidays, and paid time off.
• Competitive insurance and saving accounts.
• Retirement benefits.

Remote work is an option for this position on a voluntary basis; however, it is important to note that this role is headquartered in Madison, WI, and the tasks of the position require occasional work-related travel.

WIDA operates in a Windows-based environment and a Dell PC laptop will be issued for use in this role.

Qualifications

• Minimum 1 year of experience in psychometrics theory, research, and statistics.
• Experience with data manipulation and statistical/psychometrics analyses using Winsteps, SAS, R, or other related software packages.
• Familiarity with multistage adaptive testing, Rasch model, and graded response IRT models.
• Ability to write technical and research reports.
• Ability to work independently and collaboratively within a team.
• Experience collaborating with external vendors or partners.

Requirements

• Programming skills, including proficiency in Python or similar programming languages used for psychometric modeling, statistical analysis, and assessment research.
• Experience applying artificial intelligence (AI) methods to assessment and measurement, such as natural language processing (NLP), automated scoring, machine learning, or related technologies.
• Test security related analysis, training or experience.
• Experience working with K–12 educational assessments, language proficiency assessments, or large-scale standardized testing programs.

Education

• Ph.D. in Educational Measurement or related field with an emphasis on psychometrics or quantitative methods.

How to Apply

Please go to the “Apply Now” area and select your current UW Employment Status. Upload a copy of:

• A Cover Letter that speaks to your education and experience and how it relates to this position.
• Current Resume/CV.

Note: There is one upload area in Workday, but you can upload multiple documents to your application. Incomplete application packages that do not include all of the requested documentation will not be considered.

Contact Information

Joy Pfeiffer
HR Generalist
[email protected]

Institutional Statement on Diversity

Diversity is a source of strength, creativity, and innovation for UW-Madison. We value the contributions of each person and respect the profound ways their identity, culture, background, experience, status, abilities, and opinion enrich the university community.