Evidence of nicotine replacement's effectiveness dissolves when meta-regression accommodates multiple sources of bias

Abstract

Objectives: To accommodate and correct identifiable bias and risks of bias among clinical trials of nicotine replacement therapy (NRT).

Study design and setting: Meta-regression analysis of a published Cochrane Collaboration systematic review of 122 placebo-controlled clinical trials.

Results: Both identified risks of bias and potential publication (or reporting or small sample) bias are associated with an increase in the reported effectiveness of NRT. Whenever multiple sources of biases are accommodated by meta-regression, no evidence of a practically notable or statistically significant overall increased rate of smoking cessation remains. Our findings are in stark contrast with the 50% to 70% increase in smoking cessation reported by the Cochrane Collaboration systematic review.

Conclusion: After more than 100 randomized clinical trials have been conducted, the overall effectiveness of NRT is in doubt. Simple, well-established meta-regression methods can test, accommodate, and correct multiple sources biases, often mentioned but dismissed by conventional systematic reviews.

Keywords: Egger regression; Meta-regression; Nicotine replacement therapy; Precision-effect test; Publication bias; Risks of bias.