Clinical Experience Is Not a Proxy for Competence: Comparing Fellow and Medical Student Performance in a Breaking Bad News Simulation-Based Mastery Learning Curriculum

Am J Hosp Palliat Care. 2023 Apr;40(4):423-430. doi: 10.1177/10499091221106176. Epub 2022 May 31.

Abstract

Background: It is unknown whether traditional medical education ensures competence among fellows in the key skill of breaking bad news (BBN). While simulation-based mastery learning (SBML) has been used to train fourth-year medical students (M4s) in BBN, it is unclear if it adds similar value for fellows.

Objective: We examined the effect of traditional medical training on BBN skills by comparing baseline fellow and M4 skills and confidence and assessed the impact of a BBN SBML curriculum for fellows.

Methods: Fellows training in six programs at Northwestern University from November 2018 to May 2019 were eligible for inclusion. Fellows completed a BBN SBML curriculum including a pretest, individualized feedback using a previously published assessment tool, and ongoing deliberate practice until all achieved a minimum passing standard (MPS). The primary outcomes were checklist and scaled item scores on the assessment tool. Fellow performance was compared to a historical M4 cohort.

Results: Twenty-eight of 38 eligible fellows completed the curriculum and were included for analysis. Fellows reported significantly more experience and confidence in BBN compared to M4s, yet their pre-training performance was significantly worse on checklist (57.1% vs 65.0%, P = .02) and scaled items; only 4% reached the MPS. After training, fellow performance significantly improved on checklist (57.1% to 92.6%, SD = 5.2%, P < .001) and scaled items; all reached the MPS.

Conclusions: Despite higher confidence and BBN clinical experience, fellows performed worse than untrained M4s, confirming that experience is not a proxy for skill. Programs must develop competency-based assessments to ensure entrustment of communication skills.

Keywords: breaking bad news; communication; graduate medical education; palliative care.

MeSH terms

  • Clinical Competence
  • Curriculum
  • Education, Medical*
  • Humans
  • Learning
  • Students, Medical*