Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2019 Jan;20(1):87-91.
doi: 10.5811/westjem.2018.11.39730. Epub 2018 Dec 12.

Standardized Video Interviews Do Not Correlate to United States Medical Licensing Examination Step 1 and Step 2 Scores

Affiliations
Free PMC article

Standardized Video Interviews Do Not Correlate to United States Medical Licensing Examination Step 1 and Step 2 Scores

Daniel J Egan et al. West J Emerg Med. .
Free PMC article

Abstract

Introduction: In 2017, the Standardized Video Interview (SVI) was required for applicants to emergency medicine (EM). The SVI contains six questions highlighting professionalism and interpersonal communication skills. The responses were scored (6-30). As it is a new metric, no information is available on correlation between SVI scores and other application data. This study was to determine if a correlation exists between applicants' United States Medical Licensing Examination (USMLE) and SVI scores. We hypothesized that numeric USMLE Step 1 and Step 2 Clinical Knowledge (CK) scores would not correlate with the SVI score, but that performance on the Step 2 Clinical Skills (CS) portion may correlate with the SVI since both test communication skills.

Methods: Nine EM residency sites participated in the study with data exported from an Electronic Residency Application Service (ERAS®) report. All applicants with both SVI and USMLE scores were included. We studied the correlation between SVI scores and USMLE scores. Predetermined subgroup analysis was performed based on applicants' USMLE Step 1 and Step 2 CK scores as follows: (≥ 200, 201-220, 221-240, 241-260, >260). We used linear regression, the Kruskal-Wallis test and Mann-Whitney U test for statistical analyses.

Results: 1,325 applicants had both Step 1 and SVI scores available, with no correlation between the overall scores (p=0.58) and no correlation between the scores across all Step 1 score ranges, (p=0.29). Both Step 2 CK and SVI scores were available for 1,275 applicants, with no correlation between the overall scores (p=0.56) and no correlation across all ranges, (p=0.10). The USMLE Step 2 CS and SVI scores were available for 1,000 applicants. Four applicants failed the CS test without any correlation to the SVI score (p=0.08).

Conclusion: We found no correlation between the scores on any portion of the USMLE and the SVI; therefore, the SVI provides new information to application screeners.

Conflict of interest statement

Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

Figures

Figure
Figure
USMLE step I score versus SVI score (top). USMLE step II CK score versus SVI score (bottom). USMLE, United States Medical Licensing Examination; SVI, standardized video interview; CK, clinical knowledge.

Similar articles

See all similar articles

Cited by 1 article

References

    1. Hegarty CB, Lane DR, Love JN, et al. Council of Emergency Medicine Residency Directors standardized letter of recommendation writers’ questionnaire. J Grad Med Educ. 2014;6(2):301–6. - PMC - PubMed
    1. Chole RA, Ogden MA. Predictors of future success in otolaryngology residency applicants. Arch Otolaryngol Head Neck Surg. 2012;138(8):707–12. - PubMed
    1. DeZee KJ, Thomas MR, Mintz M, et al. Letters of recommendation: rating, writing, and reading by clerkship directors of internal medicine. Teach Learn Med. 2009;21(2):153–8. - PubMed
    1. Shultz K, Mahabir RC, Song J, et al. Evaluation of the current perspectives on letters of recommendation for residency applicants among plastic surgery program directors. Plast Surg Int. 2012;2012:728981. - PMC - PubMed
    1. Messner AH, Shimahara E. Letters of recommendation to an otolaryngology/head and neck surgery residency program: their function and the role of gender. Laryngoscope. 2008;118(8):1335–44. - PubMed

LinkOut - more resources

Feedback