Notes From the Field: Direct Observation Versus Rating by Videos for the Assessment of Central Venous Catheterization Skills

Eval Health Prof. 2015 Sep;38(3):419-22. doi: 10.1177/0163278713518942. Epub 2014 Jan 12.


Blinded assessments of technical skills using video-recordings may offer more objective assessments than direct observations. This study seeks to compare these two modalities. Two trained assessors independently assessed 18 central venous catheterization performances by direct observation and video-recorded assessments using two tools. Although sound quality was deemed adequate in all videos, portions of the video for wire handling and drape handling were frequently out of view (n = 13, 72% for wire-handling; n = 17, 94% for drape-handling). There were no differences in summary global rating scores, checklist scores, or pass/fail decisions for either modality (p > 0.05). Inter-rater reliability was acceptable for both modalities. Of the 26 discrepancies identified between direct observation and video-recorded assessments, three discrepancies (12%) were due to inattention during video review, while one (4%) discrepancy was due to inattention during direct observation. In conclusion, although scores did not differ between the two assessment modalities, techniques of video-recording may significantly impact individual items of assessments.

Keywords: assessment; catheterization; central venous; observation; simulation; videotape recording.

MeSH terms

  • Canada
  • Catheterization, Central Venous / standards*
  • Checklist
  • Clinical Competence*
  • Education, Medical / methods*
  • Educational Measurement
  • Humans
  • Manikins
  • Observation
  • Process Assessment, Health Care*
  • Reproducibility of Results
  • Video Recording*