False Positive Rates of Randomized Phase II Designs

Control Clin Trials. 1999 Aug;20(4):343-52. doi: 10.1016/s0197-2456(99)00009-4.

Abstract

The randomized Phase II design for the purpose of selecting a treatment for eventual Phase III testing has recently gained popularity in cancer clinical research. Unfortunately, along with its wider use also come frequent misapplications. The major misuse of the design is the treatment of the Phase II results as ends in themselves without further, definitive evaluation. For binary and censored exponential survival data, we quantify the chance of observing "impressive" between-group differences when underlying distributions are exactly the same in 2-, 3-, and 4-arm selection designs. Depending on one's view of what is impressive, the "false-positive" rates range from 20% to over 40%. We stress that randomized Phase II results are pilots to Phase III evaluations. One should not regard them as conclusive. We caution especially against the inclusion of control arms in such designs because of the propensity for erroneous inferences. We also discuss the inappropriate practice of performing post-hoc hypothesis testing and presenting p-values that are less than 0.05.

Publication types

  • Research Support, U.S. Gov't, P.H.S.
  • Review

MeSH terms

  • Clinical Trials, Phase II as Topic / statistics & numerical data*
  • Clinical Trials, Phase III as Topic / statistics & numerical data
  • Humans
  • Pilot Projects
  • Randomized Controlled Trials as Topic / statistics & numerical data*
  • Selection Bias
  • Survival Rate