Skip to main page content
Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
, 4 (1), 28

Replication Initiatives Will Not Salvage the Trustworthiness of Psychology


Replication Initiatives Will Not Salvage the Trustworthiness of Psychology

James C Coyne. BMC Psychol.


Replication initiatives in psychology continue to gather considerable attention from far outside the field, as well as controversy from within. Some accomplishments of these initiatives are noted, but this article focuses on why they do not provide a general solution for what ails psychology. There are inherent limitations to mass replications ever being conducted in many areas of psychology, both in terms of their practicality and their prospects for improving the science. Unnecessary compromises were built into the ground rules for design and publication of the Open Science Collaboration: Psychology that undermine its effectiveness. Some ground rules could actually be flipped into guidance for how not to conduct replications. Greater adherence to best publication practices, transparency in the design and publishing of research, strengthening of independent post-publication peer review and firmer enforcement of rules about data sharing and declarations of conflict of interest would make many replications unnecessary. Yet, it has been difficult to move beyond simple endorsement of these measures to consistent implementation. Given the strong institutional support for questionable publication practices, progress will depend on effective individual and collective use of social media to expose lapses and demand reform. Some recent incidents highlight the necessity of this.

Keywords: Publication bias; Randomized controlled trials; Reproducibility; p-hacking.

Similar articles

See all similar articles

Cited by 3 articles


    1. Brembs B. Predatory practices. Bjoem.Brembs.Blog.September 23, 2015. Accessed 08 Apr 2016.
    1. Gilbert D, King G, Pettigrew S, Wilson T. Comment on 'Estimating the reproducibility of psychological science. Science. 2016;351(6277):1037a–1037b. doi: 10.1126/science.aad7243. - DOI - PubMed
    1. Anderson CJ, Bahník Š, Barnett-Cowan M, Bosco FA, Chandler J, Chartier CR, Cheung F, Christopherson CD, Cordes A, Cremata EJ, Della Penna N, Estel V, Fedor A, Fitneva SA, Frank MC, Grange JA, Hartshorne JK, Hasselman F, Henninger F, van der Hulst M, Jonas KJ, Lai CK, Levitan CA, Miller JK, Moore KS, Meixner JM, Munafò MR, Neijenhuijs KI, Nilsonne G, Nosek BA, Plessow F, Prenoveau JM, Ricker AA, Schmidt K, Spies JR, Stieger S, Strohminger N, Sullivan GB, van Aert RC, van Assen MA, Vanpaemel W, Vianello M, Voracek M, Zuni K. Response to comment on “estimating the reproducibility of psychological science”. Science. 2016;351(6277):1037. doi: 10.1126/science.aad9163. - DOI - PubMed
    1. Open Science Collaboration Estimating the reproducibility of psychological science. Science. 2015;349(6251):aac4716. doi: 10.1126/science.aac4716. - DOI - PubMed
    1. Gelman A. Replication crisis crisis: Why I continue in my “pessimistic conclusions about reproducibility.” Statistical Modeling, Causal Inference, and Social Science. 2016.

LinkOut - more resources