Integrative Data Analysis (IDA) encompasses a collection of methods for data synthesis that pools participant-level data across multiple studies. Compared with single-study analyses, IDA provides larger sample sizes, better representation of participant characteristics, and often increased statistical power. Many of the methods currently available for IDA have focused on examining developmental changes using longitudinal observational studies employing different measures across time and study. However, IDA can also be useful in synthesizing across multiple randomized clinical trials to improve our understanding of the comprehensive effectiveness of interventions, as well as mediators and moderators of those effects. The pooling of data from randomized clinical trials presents a number of methodological challenges, and we discuss ways to examine potential threats to internal and external validity. Using as an illustration a synthesis of 19 randomized clinical trials on the prevention of adolescent depression, we articulate IDA methods that can be used to minimize threats to internal validity, including (1) heterogeneity in the outcome measures across trials, (2) heterogeneity in the follow-up assessments across trials, (3) heterogeneity in the sample characteristics across trials, (4) heterogeneity in the comparison conditions across trials, and (5) heterogeneity in the impact trajectories. We also demonstrate a technique for minimizing threats to external validity in synthesis analysis that may result from non-availability of some trial datasets. The proposed methods rely heavily on latent variable modeling extensions of the latent growth curve model, as well as missing data procedures. The goal is to provide strategies for researchers considering IDA.
Keywords: Harmonization; Integrative data analysis; Participant-level meta-analysis; Synthesis methodology.
Conflict of interest statement
CHB was supported as a consultant on one of these projects (New Beginnings) and received funding support on the Familias Unidas trials as did Brincks, Huang, and Pantin who developed and directed much of research on this intervention. Sandler developed and directed much of the work on two trials in this synthesis.
Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials.Cochrane Database Syst Rev. 2014 Apr 29;(4):MR000034. doi: 10.1002/14651858.MR000034.pub2. Cochrane Database Syst Rev. 2014. PMID: 24782322 Review.
Behavioral interventions to reduce risk for sexual transmission of HIV among men who have sex with men.Cochrane Database Syst Rev. 2008 Jul 16;(3):CD001230. doi: 10.1002/14651858.CD001230.pub2. Cochrane Database Syst Rev. 2008. PMID: 18646068 Review.
Preventing internalizing symptoms among Hispanic adolescents: a synthesis across Familias Unidas trials.Prev Sci. 2014 Dec;15(6):917-28. doi: 10.1007/s11121-013-0448-9. Prev Sci. 2014. PMID: 24390684 Free PMC article.
Multiple imputation for harmonizing longitudinal non-commensurate measures in individual participant data meta-analysis.Stat Med. 2015 Nov 20;34(26):3399-414. doi: 10.1002/sim.6562. Epub 2015 Jun 21. Stat Med. 2015. PMID: 26095855 Free PMC article.
Repetitive transcranial magnetic stimulation for the treatment of major depressive disorder: an evidence-based analysis.Ont Health Technol Assess Ser. 2004;4(7):1-98. Epub 2004 Jun 1. Ont Health Technol Assess Ser. 2004. PMID: 23074457 Free PMC article.
Cited by 7 articles
Evaluating construct equivalence of youth depression measures across multiple measures and multiple studies.Psychol Assess. 2019 Sep;31(9):1154-1167. doi: 10.1037/pas0000737. Epub 2019 Jul 1. Psychol Assess. 2019. PMID: 31259571
Multivariate Higher-Order IRT Model and MCMC Algorithm for Linking Individual Participant Data From Multiple Studies.Front Psychol. 2019 Jun 12;10:1328. doi: 10.3389/fpsyg.2019.01328. eCollection 2019. Front Psychol. 2019. PMID: 31244727 Free PMC article.
Methodological Considerations for Advancing Research on the Health and Wellbeing of Sexual and Gender Minority Youth.LGBT Health. 2019 May/Jun;6(4):156-165. doi: 10.1089/lgbt.2018.0141. LGBT Health. 2019. PMID: 31145662 Free PMC article.
Behavioral Research Agenda in a Multietiological Approach to Child Obesity Prevention.Child Obes. 2019 May/Jun;15(4):223-226. doi: 10.1089/chi.2019.0052. Epub 2019 Mar 29. Child Obes. 2019. PMID: 30925082 No abstract available.
Estimating the risk of PTSD in recent trauma survivors: results of the International Consortium to Predict PTSD (ICPP).World Psychiatry. 2019 Feb;18(1):77-87. doi: 10.1002/wps.20608. World Psychiatry. 2019. PMID: 30600620 Free PMC article.
- R01 DA018374/DA/NIDA NIH HHS/United States
- R01-DA13773/DA/NIDA NIH HHS/United States
- R01-DA007029/DA/NIDA NIH HHS/United States
- R01 MH052270/MH/NIMH NIH HHS/United States
- R01 MH064735/MH/NIMH NIH HHS/United States
- K07 CA154862/CA/NCI NIH HHS/United States
- R01-MH048696/MH/NIMH NIH HHS/United States
- R01 DA007031/DA/NIDA NIH HHS/United States
- R01 MH049155/MH/NIMH NIH HHS/United States
- R01 MH040859/MH/NIMH NIH HHS/United States
- K23 MH071320/MH/NIMH NIH HHS/United States
- R01 HL127491/HL/NHLBI NIH HHS/United States
- R01 DA017462/DA/NIDA NIH HHS/United States
- Young Investigator Grant/National Alliance for Research on Schizophrenia and Depression/International
- R03-MH048118/MH/NIMH NIH HHS/United States
- R01 DA025894/DA/NIDA NIH HHS/United States
- R01 MH064503/MH/NIMH NIH HHS/United States
- R01 MH063042/MH/NIMH NIH HHS/United States
- R01 MH064717/MH/NIMH NIH HHS/United States
- UL1 TR000460/TR/NCATS NIH HHS/United States
- K08 MH072918/MH/NIMH NIH HHS/United States
- P30 MH068685/MH/NIMH NIH HHS/United States
- R01 MH064707/MH/NIMH NIH HHS/United States
- U01 PS000671/PS/NCHHSTP CDC HHS/United States
- 961730/William T. Grant Foundation/International