Randomized single-case AB phase designs: Prospects and pitfalls

Behav Res Methods. 2019 Dec;51(6):2454-2476. doi: 10.3758/s13428-018-1084-x.

Abstract

Single-case experimental designs (SCEDs) are increasingly used in fields such as clinical psychology and educational psychology for the evaluation of treatments and interventions in individual participants. The AB phase design, also known as the interrupted time series design, is one of the most basic SCEDs used in practice. Randomization can be included in this design by randomly determining the start point of the intervention. In this article, we first introduce this randomized AB phase design and review its advantages and disadvantages. Second, we present some data-analytical possibilities and pitfalls related to this design and show how the use of randomization tests can mitigate or remedy some of these pitfalls. Third, we demonstrate that the Type I error of randomization tests in randomized AB phase designs is under control in the presence of unexpected linear trends in the data. Fourth, we report the results of a simulation study investigating the effect of unexpected linear trends on the power of the randomization test in randomized AB phase designs. The implications of these results for the analysis of randomized AB phase designs are discussed. We conclude that randomized AB phase designs are experimentally valid, but that the power of these designs is sufficient only for large treatment effects and large sample sizes. For small treatment effects and small sample sizes, researchers should turn to more complex phase designs, such as randomized ABAB phase designs or randomized multiple-baseline designs.

Keywords: Interrupted time series design; Linear trend; Power analysis; Randomization test; Single-case experimental design.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Behavioral Research / methods*
  • Humans
  • Interrupted Time Series Analysis*
  • Random Allocation
  • Research Design*
  • Sample Size
  • Scientific Experimental Error