Procedural competence in internal medicine residents: validity of a central venous catheter insertion assessment instrument

Abstract

Purpose: Despite mandates from accreditation bodies for programs to ensure procedural competence, standardized measures do not exist to assess residents' skills in performing central venous catheter (CVC) insertion. The objective of the present study was to develop an instrument to assess residents in subclavian (SC) CVC insertion, to set performance standards, and to validate the tool using performance data.

Method: In 2007, the authors convened experts to create an assessment tool for CVC insertion using a modified Delphi method. They applied the Angoff method to a second set of experts to determine minimum passing scores (MPSs) for both the borderline trainee and the competent trainee. Two faculty evaluators then used the checklist to assess residents performing CVCs on simulators.

Results: The authors created and experts confirmed a 24-item checklist. Using the Angoff method, the MPS required completion of 10 major and 2 minor criteria for a trainee to show borderline proficiency with CVC insertion under supervision. This MPS was correlated with a global rating of 2 on a 5-point scale. The MPS for competence was 17 major and 5 minor criteria. None of the residents deemed competent on a global rating scale achieved the MPS for competence.

Conclusions: The authors were able to create and validate a consensus-driven procedural assessment tool with data-driven standards for basic proficiency and competence that faculty can use to assess residents as they perform CVC insertion.