Simpson's paradox and experimental research

Nurs Res. 2009 Mar-Apr;58(2):123-7. doi: 10.1097/NNR.0b013e318199b517.

Abstract

Background: Experimental research in nursing has increased considerably in recent years. To improve the quality of such research, it is critical to reduce threats to internal validity. One threat that has received inadequate attention in the nursing literature is Simpson's paradox--a case of extreme confounding that can lead to erroneous conclusions about the effects of an experimental intervention. In fact, it can lead to a conclusion about an intervention effect that is the opposite of the correct inference.

Approach: The aims of this study were to describe Simpson's paradox, provide a hypothetical example, and discuss approaches to avoiding the paradox.

Results: The paradox is due to the combination of an overlooked confounding variable and a disproportionate allocation of that variable among experimental groups. Different designs and analysis approaches that can be used to avoid the paradox are presented.

Discussion: Simpson's paradox can be avoided by selecting an appropriate experimental design and analysis that incorporates the confounding variable in such a way as to obtain unconfounded estimates of treatment effects, thus more accurately answering the research question.

Publication types

  • Review

MeSH terms

  • Analysis of Variance
  • Bias
  • Confounding Factors, Epidemiologic*
  • Data Interpretation, Statistical*
  • Effect Modifier, Epidemiologic
  • Humans
  • Models, Statistical
  • Nursing Research / methods*
  • Nursing Research / standards
  • Randomized Controlled Trials as Topic
  • Regression Analysis
  • Reproducibility of Results
  • Research Design / standards*
  • Severity of Illness Index
  • Treatment Outcome