Purpose: Understanding medical students' readiness to perform basic entrustable professional activities (EPAs) informs tailored support during transition to residency.
Methods: Night-onCall (NOC) was developed to assess medical student readiness to perform core EPAs on day one of internship. NOC is a complex, integrated simulation centered around three clinical cases. Assessments include standardized patient (SP), nurse (SN), physician attending (SA), and resident (SR) perspectives using clinical competency rating instruments mapped to EPAs and scored as Well Done (WD), Partly Done (PD) or Not Done (ND). Faculty rate clinical reasoning using a rubric evaluating written post-encounter notes as poor, beginning, competent, or strong. The ability to recognize lapses in patient safety is assessed based on written case responses. Medical librarians evaluate students' ability to formulate a clinical question and search for evidence.
Results: Data was collected from 'near-graduates' from seven USA medical schools from 2020 to 2023 (n = 1116). Overall, SPs rated 75.0% of overall communication skills and only 56% of patient education items as WD. SNs rated interprofessional communication 57.0% WD, and SRs rated intraprofessional communication 61.0% WD. History gathering and physical exam skills varied by case. Faculty rated clinical reasoning as beginning (45%) or competent (44%) and librarians rated 16% of literature searches as WD.
Conclusion: Most near-graduates demonstrated competent basic patient communication skills but performed less well on patient education, communication with other team members, clinical reasoning, and accessing the evidence base to answer clinical questions. These overall trends, consistent across schools and year, provide benchmarks for clinical training.
Keywords: 360 evaluation; Medical education; OSCE; Performance based assessment; Transition to residency.
© The Author(s) under exclusive licence to International Association of Medical Science Educators 2026. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.