Introduction of Patient Video Clips Into Computer-Based Testing: Effects on Item Statistics and Reliability Estimates

Acad Med. 2003 Oct;78(10 Suppl):S48-51. doi: 10.1097/00001888-200310001-00016.

Abstract

Purpose: Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown.

Method: We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship.

Results: Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions.

Conclusions: The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

Publication types

  • Comparative Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Clinical Clerkship
  • Clinical Competence / statistics & numerical data*
  • Computer Simulation*
  • Education, Medical, Undergraduate / methods
  • Educational Measurement / methods*
  • Feasibility Studies
  • Humans
  • Multimedia*
  • Nervous System Diseases / diagnosis
  • Patient Simulation*
  • Reproducibility of Results
  • Students, Medical
  • United States