Confirmatory Factor Analysis of the System for Evaluation of Teaching Qualities (SETQ) in Graduate Medical Training

Benjamin C M Boerebach; Kiki M J M H Lombarts; Onyebuchi A Arah

doi:10.1177/0163278714552520

Confirmatory Factor Analysis of the System for Evaluation of Teaching Qualities (SETQ) in Graduate Medical Training

Eval Health Prof. 2016 Mar;39(1):21-32. doi: 10.1177/0163278714552520. Epub 2014 Oct 2.

Authors

Benjamin C M Boerebach¹, Kiki M J M H Lombarts², Onyebuchi A Arah³

Affiliations

¹ Professional Performance research group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands b.c.boerebach@amc.uva.nl.
² Professional Performance research group, Center for Evidence-Based Education, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.
³ Department of Epidemiology, University of California, Los Angeles (UCLA), School of Public Health, Los Angeles, CA, USA UCLA Center for Health Policy Research, Los Angeles, CA, USA.

PMID: 25280728
DOI: 10.1177/0163278714552520

Abstract

The System for Evaluation of Teaching Qualities (SETQ) was developed as a formative system for the continuous evaluation and development of physicians' teaching performance in graduate medical training. It has been seven years since the introduction and initial exploratory psychometric analysis of the SETQ questionnaires. This study investigates the validity and reliability of the SETQ questionnaires across hospitals and medical specialties using confirmatory factor analyses (CFAs), reliability analysis, and generalizability analysis. The SETQ questionnaires were tested in a sample of 3,025 physicians and 2,848 trainees in 46 hospitals. The CFA revealed acceptable fit of the data to the previously identified five-factor model. The high internal consistency estimates suggest satisfactory reliability of the subscales. These results provide robust evidence for the validity and reliability of the SETQ questionnaires for evaluating physicians' teaching performance.

Keywords: confirmatory factor analysis; feedback; physicians; postgraduate medical education; teaching performance; trainees.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Education, Medical, Graduate / standards*
Factor Analysis, Statistical
Faculty, Medical / education*
Faculty, Medical / standards*
Formative Feedback
Hospitals, Teaching / standards*
Humans
Netherlands
Professional Competence
Program Evaluation
Psychometrics
Reproducibility of Results