Effectiveness of a focused educational intervention on resident evaluations from faculty a randomized controlled trial

J Gen Intern Med. 2001 Jul;16(7):427-34. doi: 10.1046/j.1525-1497.2001.016007427.x.

Abstract

Objective: To improve the quality and specificity of written evaluations by faculty attendings of internal medicine residents during inpatient rotations.

Design: Prospective randomized controlled trial.

Setting: Four hospitals: tertiary care university hospital, Veterans' Administration hospital, and two community hospitals.

Participants: Eighty-eight faculty and 157 residents from categorical and primary-care internal medicine residency training programs rotating on inpatient general medicine teams.

Intervention: Focused 20-minute educational session on evaluation and feedback, accompanied by 3 by 5 reminder card and diary, given to faculty at the start of their attending month.

Primary outcomes: 1) number of written comments from faculty specific to unique, preselected dimensions of competence; 2) number of written comments from faculty describing a specific resident behavior or providing a recommendation; and 3) resident Likert-scale ratings of the quantity and effect of feedback received from faculty. Faculty in the intervention group provided more written comments specific to defined dimensions of competence, a median of three comments per evaluation form versus two in the control group, but when adjusted for clustering by faculty, the difference was not statistically significant (P =.09). Regarding feedback, residents in the intervention group rated the quantity significantly higher (P =.04) and were significantly more likely to make changes in clinical management of patients than residents in the control group (P =.04).

Conclusions: A brief, focused educational intervention delivered to faculty prior to the start of a ward rotation appears to have a modest effect on faculty behavior for written evaluations and promoted higher quality feedback given to house staff.

Publication types

  • Clinical Trial
  • Multicenter Study
  • Randomized Controlled Trial

MeSH terms

  • Clinical Competence
  • Educational Measurement*
  • Faculty, Medical*
  • Female
  • Humans
  • Internal Medicine / education*
  • Internship and Residency / methods*
  • Male
  • Prospective Studies
  • Statistics as Topic
  • Surveys and Questionnaires