Most tumour necrosis factor inhibitor trials in rheumatology are undeservedly called 'efficacy and safety' trials: a survey of power considerations

Rheumatology (Oxford). 2008 Jul;47(7):1054-7. doi: 10.1093/rheumatology/ken190. Epub 2008 May 21.

Abstract

Objectives: Many randomized clinical trials (RCTs) are labelled efficacy and safety while due consideration for power is provided only for efficacy outcomes. This in turn necessitates a discussion of the inadequacy of sample size (type II error) for identifying harm. This is particularly important in RCTs of TNF inhibitors as harm related to these agents is still a matter of debate.

Methods: PubMed was searched for all RCTs published examining TNF inhibitors in RA, PsA and AS. Only original study reports were surveyed for whether: (i) they were labelled as efficacy, safety or both; (ii) the methods sections included safety as a primary or secondary end point; (iii) power calculations were adequately explained; (iv) statistical tests of significance were given for harm; and finally (v) any discussion of type II error for harm was present.

Results: Of the 34 articles surveyed, 24 (71%) were labelled as efficacy and safety. Among these, 23 (96%) did not include safety as a formal primary or secondary end point. In only 2/24 (8%) power calculations were given for safety. Finally, in only 3/22 (14%) any discussion about the inadequate sample size (type II error) for detecting harm could be found.

Conclusions: Most reports of RCTs of TNF inhibitors in rheumatological diseases are inappropriately labelled as addressing efficacy and safety. Their lack of power in detecting harm is not adequately discussed, either.

Publication types

  • Review

MeSH terms

  • Antirheumatic Agents / adverse effects
  • Antirheumatic Agents / therapeutic use*
  • Arthritis / drug therapy*
  • Humans
  • Randomized Controlled Trials as Topic / methods*
  • Randomized Controlled Trials as Topic / standards
  • Research Design
  • Sample Size
  • Terminology as Topic
  • Treatment Outcome
  • Tumor Necrosis Factor-alpha / antagonists & inhibitors*

Substances

  • Antirheumatic Agents
  • Tumor Necrosis Factor-alpha