Assessing Physician's Motivational Communication Skills: 5-Step Mixed Methods Development Study of the Motivational Communication Competency Assessment Test

Vincent Gosselin Boucher; Simon Bacon; Brigitte Voisard; Anda I Dragomir; Claudia Gemme; Florent Larue; Sara Labbé; Geneviève Szczepanik; Kimberly Corace; Tavis Campbell; Michael Vallis; Gary Garber; Codie Rouleau; Jean G Diodati; Doreen Rabi; Serge Sultan; Kim Lavoie; Network For Health Behavior Change And Promotion (CAN-Change)

doi:10.2196/31489

Assessing Physician's Motivational Communication Skills: 5-Step Mixed Methods Development Study of the Motivational Communication Competency Assessment Test

JMIR Med Educ. 2022 Jun 24;8(2):e31489. doi: 10.2196/31489.

Authors

Vincent Gosselin Boucher^{1

2}, Simon Bacon^{1

3}, Brigitte Voisard^{1

2}, Anda I Dragomir^{1

2}, Claudia Gemme^{1

2}, Florent Larue⁴, Sara Labbé^{1

2}, Geneviève Szczepanik¹, Kimberly Corace^{5

6}, Tavis Campbell^{7

8}, Michael Vallis⁹, Gary Garber^{10

11}, Codie Rouleau⁵, Jean G Diodati¹, Doreen Rabi¹², Serge Sultan¹³, Kim Lavoie^{1

2}; Network For Health Behavior Change And Promotion (CAN-Change)¹⁴

Affiliations

¹ Montreal Behavioural Medicine Centre, Centre Intégré Universitaire de santé et services sociaux du Nord-de-l'Ile-de-Montréal (CIUSSSNIM), Montreal, QC, Canada.
² Department of Psychology, Université du Québec à Montréal, Montréal, QC, Canada.
³ Department of Health, Kinesiology and Applied Physiology, Concordia University, Montreal, QC, Canada.
⁴ Faculty of Medicine of Montpellier, Montpellier, France.
⁵ Department of Psychiatry, University of Ottawa, Ottawa, ON, Canada.
⁶ The Royal's Institute of Mental Health Research, Ottawa, ON, Canada.
⁷ Total Cardiology Cardiac Rehabilitation, Calgary, AB, Canada.
⁸ Department of Psychology, University of Calgary, Calgary, AB, Canada.
⁹ Department of Family Medicine, Dalhousie University, Halifax, NS, Canada.
¹⁰ Department of Medicine, University of Ottawa, Ottawa, ON, Canada.
¹¹ Department of Medicine, University of Toronto, Toronto, ON, Canada.
¹² Department of Community Health Sciences, University of Calgary, Calgary, AB, Canada.
¹³ Department of Pediatrics, Université de Montréal, Montreal, QC, Canada.
¹⁴ Canadian Network for Health Behavior Change and Promotion (CAN-Change), Montreal, QC, Canada.

PMID: 35749167
PMCID: PMC9270716
DOI: 10.2196/31489

Abstract

Background: Training physicians to provide effective behavior change counseling using approaches such as motivational communication (MC) is an important aspect of noncommunicable chronic disease prevention and management. However, existing evaluation tools for MC skills are complex, invasive, time consuming, and impractical for use within the medical context.

Objective: The objective of this study is to develop and validate a short web-based tool for evaluating health care provider (HCP) skills in MC-the Motivational Communication Competency Assessment Test (MC-CAT).

Methods: Between 2016 and 2021, starting with a set of 11 previously identified core MC competencies and using a 5-step, mixed methods, integrated knowledge translation approach, the MC-CAT was created by developing a series of 4 base cases and a scoring scheme, validating the base cases and scoring scheme with international experts, creating 3 alternative versions of the 4 base cases (to create a bank of 16 cases, 4 of each type of base case) and translating the cases into French, integrating the cases into the web-based MC-CAT platform, and conducting initial internal validity assessments with university health students.

Results: The MC-CAT assesses MC competency in 20 minutes by presenting HCPs with 4 out of a possible 16 cases (randomly selected and ordered) addressing various behavioral targets (eg, smoking, physical activity, diet, and medication adherence). Individual and global competency scores were calculated automatically for the 11 competency items across the 4 cases, providing automatic scores out of 100. From the factorial analysis of variance for the difference in competency and ranking scores, no significant differences were identified between the different case versions across individual and global competency (P=.26 to P=.97) and ranking scores (P=.24 to P=.89). The initial tests of internal consistency for rank order among the 24 student participants were in the acceptable range (α=.78).

Conclusions: The results suggest that MC-CAT is an internally valid tool to facilitate the evaluation of MC competencies among HCPs and is ready to undergo comprehensive psychometric property analyses with a national sample of health care providers. Once psychometric property assessments have been completed, this tool is expected to facilitate the assessment of MC skills among HCPs, skills that will better support patients in adopting healthier lifestyles, which will significantly reduce the personal, social, and economic burdens of noncommunicable chronic diseases.

Keywords: assessment; health promotion; motivational communication; physicians; tool development.

©Vincent Gosselin Boucher, Simon Bacon, Brigitte Voisard, Anda I Dragomir, Claudia Gemme, Florent Larue, Sara Labbé, Geneviève Szczepanik, Kimberly Corace, Tavis Campbell, Michael Vallis, Gary Garber, Codie Rouleau, Jean G Diodati, Doreen Rabi, Serge Sultan, Kim Lavoie, Network For Health Behavior Change And Promotion (CAN-Change). Originally published in JMIR Medical Education (https://mededu.jmir.org), 24.06.2022.