Multilevel meta-analysis of single-subject experimental designs: a simulation study

Behav Res Methods. 2012 Dec;44(4):1244-54. doi: 10.3758/s13428-012-0213-1.

Abstract

One way to combine data from single-subject experimental design studies is by performing a multilevel meta-analysis, with unstandardized or standardized regression coefficients as the effect size metrics. This study evaluates the performance of this approach. The results indicate that a multilevel meta-analysis of unstandardized effect sizes results in good estimates of the effect. The multilevel meta-analysis of standardized effect sizes, on the other hand, is suitable only when the number of measurement occasions for each subject is 20 or more. The effect of the treatment on the intercept is estimated with enough power when the studies are homogeneous or when the number of studies is large; the power of the effect on the slope is estimated with enough power only when the number of studies and the number of measurement occasions are large.

Publication types

  • Meta-Analysis
  • Research Support, U.S. Gov't, P.H.S.

MeSH terms

  • Data Interpretation, Statistical*
  • Models, Statistical*
  • Research Design*