Background: There is a growing interest in the use of Bayesian adaptive designs in late-phase clinical trials. This includes the use of stopping rules based on Bayesian analyses in which the frequentist type I error rate is controlled as in frequentist group-sequential designs.
Methods: This paper presents a practical comparison of Bayesian and frequentist group-sequential tests. Focussing on the setting in which data can be summarised by normally distributed test statistics, we evaluate and compare boundary values and operating characteristics.
Results: Although Bayesian and frequentist group-sequential approaches are based on fundamentally different paradigms, in a single arm trial or two-arm comparative trial with a prior distribution specified for the treatment difference, Bayesian and frequentist group-sequential tests can have identical stopping rules if particular critical values with which the posterior probability is compared or particular spending function values are chosen. If the Bayesian critical values at different looks are restricted to be equal, O'Brien and Fleming's design corresponds to a Bayesian design with an exceptionally informative negative prior, Pocock's design to a Bayesian design with a non-informative prior and frequentist designs with a linear alpha spending function are very similar to Bayesian designs with slightly informative priors.This contrasts with the setting of a comparative trial with independent prior distributions specified for treatment effects in different groups. In this case Bayesian and frequentist group-sequential tests cannot have the same stopping rule as the Bayesian stopping rule depends on the observed means in the two groups and not just on their difference. In this setting the Bayesian test can only be guaranteed to control the type I error for a specified range of values of the control group treatment effect.
Conclusions: Comparison of frequentist and Bayesian designs can encourage careful thought about design parameters and help to ensure appropriate design choices are made.
Keywords: Adaptive design; Interim analysis; Sequential analysis; Sequential design; Type I error rate.
Conflict of interest statement
The authors declare that they have no competing interests.
Bayesian decision-theoretic group sequential clinical trial design based on a quadratic loss function: a frequentist evaluation.Clin Trials. 2007;4(1):5-14. doi: 10.1177/1740774506075764. Clin Trials. 2007. PMID: 17327241
A Bayesian Stopping Rule for Sequential Monitoring of Serious Adverse Events.Ther Innov Regul Sci. 2014 Jul;48(4):444-452. doi: 10.1177/2168479014525378. Ther Innov Regul Sci. 2014. PMID: 30235573
Bayesian group sequential designs for phase III emergency medicine trials: a case study using the PARAMEDIC2 trial.Trials. 2020 Jan 14;21(1):84. doi: 10.1186/s13063-019-4024-x. Trials. 2020. PMID: 31937351 Free PMC article.
Bayesian randomized clinical trials: From fixed to adaptive design.Contemp Clin Trials. 2017 Aug;59:77-86. doi: 10.1016/j.cct.2017.04.010. Epub 2017 Apr 26. Contemp Clin Trials. 2017. PMID: 28455232 Review.
Comparison of multi-arm multi-stage design and adaptive randomization in platform clinical trials.Contemp Clin Trials. 2017 Mar;54:48-59. doi: 10.1016/j.cct.2017.01.003. Epub 2017 Jan 13. Contemp Clin Trials. 2017. PMID: 28089763 Review.
- Jennison C, Turnbull BW. Group Sequential Methods with Applications to Clinical Trials. Boca Raton: Chapman & Hall; 2000.
- Berry SM, Carlin BP, Lee JJ, Müller P. Bayesian Adaptive Methods for Clinical Trials. Boca Raton: CRC Press; 2011.
- Spiegelhalter DJ, Freedman LS, Parmar MKB. Bayesian approaches to randomized trials. J R Stat Soc Ser A. 1994;157:357–416. doi: 10.2307/2983527. - DOI