Using a matrix-analytical approach to synthesizing evidence solved incompatibility problem in the hierarchy of evidence

J Clin Epidemiol. 2015 Nov;68(11):1251-60. doi: 10.1016/j.jclinepi.2015.03.027. Epub 2015 Jul 4.

Abstract

Objectives: The hierarchy of evidence presupposes linearity and additivity of effects, as well as commutativity of knowledge structures. It thereby implicitly assumes a classical theoretical model.

Study design and setting: This is an argumentative article that uses theoretical analysis based on pertinent literature and known facts to examine the standard view of methodology.

Results: We show that the assumptions of the hierarchical model are wrong. The knowledge structures gained by various types of studies are not sequentially indifferent, that is, do not commute. External validity and internal validity are at least partially incompatible concepts. Therefore, one needs a different theoretical structure, typical of quantum-type theories, to model this situation. The consequence of this situation is that the implicit assumptions of the hierarchical model are wrong, if generalized to the concept of evidence in total.

Conclusion: The problem can be solved by using a matrix-analytical approach to synthesizing evidence. Here, research methods that produce different types of evidence that complement each other are synthesized to yield the full knowledge. We show by an example how this might work. We conclude that the hierarchical model should be complemented by a broader reasoning in methodology.

Keywords: Evidence-based medicine; Hierarchy of methods; Matrix analysis; Methodology; Placebo; Quantum theory.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Biomedical Research / classification*
  • Biomedical Research / methods*
  • Evidence-Based Medicine / statistics & numerical data*
  • Models, Theoretical*
  • Placebo Effect
  • Quantum Theory
  • Review Literature as Topic