Interpretations of reproducibility crisis in medical education research: a qualitative study

Abstract

The scientific community is currently grappling with the "reproducibility crisis," a phenomenon characterized by a significant loss of validity in research outcomes and a subsequent decline in public and scientific confidence. This crisis is evident in the high rate of studies, particularly within medicine and the humanities that fail replication tests and exhibit poor generalizability. This study aimed to specifically examine the issues of reproducibility in medical education research in Iran and propose effective solutions to address this challenge. This investigation employed a qualitative methodology, utilizing conventional content analysis. Data were collected through in-depth, semi-structured interviews with a carefully selected group of 24 medical science professors. Interviewing continued until data saturation was achieved, with each session lasting between 60 and 90 min. The analysis was systematically performed using the established Graneheim and Lundman's framework. The analysis led to the identification of three themes: factors contributing to the reproducibility crisis, its consequences, and potential solutions. These themes were further divided into eight categories. Contributing factors encompassed research methodology, various forms of bias, and contextual elements. The consequences were primarily reflected in two domains-scientific progress and decision-making in educational contexts. In contrast, proposed solutions centered on enhancing methodological rigor and reinforcing a culture of accountability and oversight in research practice. According to the findings, improving the quality and credibility of research in medical education requires a comprehensive strategy built upon three key pillars: advancing researchers' methodological competence, institutionalizing ethical and transparent research practices, and strengthening systems of evaluation and accountability. The effective implementation of initiatives such as the development of clear research guidelines, organization of training and capacity-building workshops, and promotion of robust inter-institutional collaboration can play a vital role in enhancing the quality, reliability, and trustworthiness of medical education research in Iran.

Keywords: Medical education; Quality education; Reproducibility crisis; Research methodology; Scientific publications.