[Hiring] Senior Efficacy Research and Psychometrics Analyst @Khan Academy

Role Description

Khan Academy Kids is looking for a Senior Efficacy Research and Psychometrics Analyst (24 months fixed-term) to strengthen the evidence base behind our assessments and learning content for children in PreK through 2nd grade. This role spans two complementary areas:

• Psychometrics & Efficacy Research:
  • Lead our psychometric research partnership.
  • Serve as the primary technical point of contact for our external psychometric research partnership, supporting study design, data sharing, psychometric analyses, and interpretation of findings.
  • Extract, clean, and securely share assessment data with research partners on a recurring schedule.
  • Analyze and interpret psychometric findings, including item difficulty, score distributions, growth analyses, concurrent validity, and IRT-based scoring.
  • Partner with our product and engineering teams to translate findings into product improvements, such as updates to scoring models and assessment discontinuation rules.
  • Collaborate with research partners to develop and publish technical documentation, beginning with the technical manual for our PreK assessment.
  • Recruit and manage research partner sites, including onboarding school and district sites for psychometric and efficacy studies.
  • Execute MOUs; align on consent procedures and participant incentives; and coordinate site visits for direct child assessment data collection.
  • Partner with our legal team to draft and negotiate data-sharing agreements with districts and research organizations.
  • Support efficacy research by coordinating Khan Academy Kids' participation in ongoing efficacy studies.
• Analytics Reporting and Data Infrastructure:
  • Own Khan Kids’s KPI dashboard, partnering with our engineering team to build and maintain it.
  • Lead recurring reporting, including monthly and quarterly business reviews and periodic target setting.
  • Field ad hoc data requests across teams, such as writing new SQL queries to support targeted district outreach or grant reporting.

Qualifications

• An advanced degree (PhD or Master's) in psychometrics, educational measurement, quantitative methods or a related field — or equivalent applied experience.
• Strong grounding in psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT).
• Proficiency with SQL and a statistical programming language (e.g., R or Python) for extracting, cleaning, analyzing, and visualizing data.
• Experience with (or eagerness to learn) business intelligence tools such as Looker, and comfort building dashboards and data pipelines.
• Familiarity with responsible data-sharing practices in education research, including student data privacy considerations (e.g., FERPA, COPPA).
• Excellent communication skills: able to translate complex psychometric findings into clear implications for product teams, funders, and school partners.
• Strong project-management and organizational skills, with the ability to coordinate multiple external partners, recurring deliverables, and data-sharing schedules with close attention to detail.
• Proven cross-cultural competency skills, demonstrating self-awareness, awareness of others, and the ability to adopt inclusive perspectives, attitudes, and behaviors.
• Motivated by Khan Academy’s mission “to provide a free, world-class education for anyone, anywhere.”

Requirements

• Experience with (or strong interest in) early childhood education and assessment of young learners is a plus.

Benefits

• Competitive salaries.
• Ample paid time off as needed – Your well-being is a priority.
• 8 pre-scheduled Wellness Days in 2026 occurring on a Monday or a Friday for a 3-day weekend boost.
• Remote-first culture - that caters to your time zone, with open flexibility as needed.
• Generous parental leave.
• An exceptional team that trusts you and gives you the freedom to do your best.
• The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products.
• Opportunities to connect through affinity, ally, and social groups.
• 401(k) + 4% matching & comprehensive insurance, including medical, dental, vision, and life.