Imputing missing standard deviations in meta-analyses can provide accurate results

J Clin Epidemiol. 2006 Jan;59(1):7-10. doi: 10.1016/j.jclinepi.2005.06.006.

Abstract

Background and objectives: Many reports of randomized controlled trials (RCTs) fail to provide standard deviations (SDs) of their continuous outcome measures. Some meta-analysts substitute them by those reported in other studies, either from another meta-analysis or from other studies in the same meta-analysis. But the validity of such practices has never been empirically examined.

Methods: We compared the actual standardized mean difference (SMD) of individual RCTs and the meta-analytically pooled SMD of all RCTs against those based on the above-mentioned two imputation methods in two meta-analyses of antidepressants.

Results: Two meta-analyses included 39 RCTs of fluoxetine (n = 3,681) and 25 RCTs of amitriptyline (n = 1,832), which had actually reported means and SDs of the Hamilton Rating Scale for Depression. According to either of the two proposed imputation methods, the agreement between actual SMDs and imputed SMDs for individual RCTs was very good with ANOVA intraclass correlation coefficients between 0.61 and 0.97. The agreement between the actual pooled SMD and the imputed one was even better, with minimal differences in both their point estimates and 95% confidence intervals.

Conclusion: For a systematic review where some of the identified trials do not report SDs, it appears safe to borrow SDs from other studies.

MeSH terms

  • Amitriptyline / therapeutic use
  • Antidepressive Agents / therapeutic use
  • Data Interpretation, Statistical*
  • Depressive Disorder / drug therapy
  • Fluoxetine / therapeutic use
  • Humans
  • Meta-Analysis as Topic*
  • Randomized Controlled Trials as Topic / standards*

Substances

  • Antidepressive Agents
  • Fluoxetine
  • Amitriptyline