Practical Methodological Reform Needs Good Theory

Perspect Psychol Sci. 2021 Jul;16(4):827-843. doi: 10.1177/1745691620977471. Epub 2021 Jan 29.

Abstract

In the face of unreplicable results, statistical anomalies, and outright fraud, introspection and changes in the psychological sciences have taken root. Vibrant reform and metascience movements have emerged. These are exciting developments and may point toward practical improvements in the future. Yet there is nothing so practical as good theory. This article outlines aspects of reform and metascience in psychology that are ripe for an injection of theory, including a lot of excellent and overlooked theoretical work from different disciplines. I review established frameworks that model the process of scientific discovery, the types of scientific networks that we ought to aspire to, and the processes by which problematic norms and institutions might evolve, focusing especially on modeling from the philosophy of science and cultural evolution. We have unwittingly evolved a toxic scientific ecosystem; existing interdisciplinary theory may help us intelligently design a better one.

Keywords: cultural evolution; diversity and inclusion; metascience; methods reform; modeling; norms; philosophy of science; theory.

MeSH terms

  • Behavioral Research / methods*
  • Behavioral Research / standards*
  • Behavioral Research / trends
  • Cultural Evolution
  • Humans
  • Philosophy
  • Psychology / methods*
  • Psychology / standards*
  • Psychology / trends
  • Research Design*