Widespread sharing of data from electronic health records and patient-reported outcomes can strengthen the national capacity for conducting cost-effective clinical trials and allow research to be embedded within routine care delivery. While pragmatic clinical trials (PCTs) have been performed for decades, they now can draw on rich sources of clinical and operational data that are continuously fed back to inform research and practice. The Health Care Systems Collaboratory program, initiated by the NIH Common Fund in 2012, engages healthcare systems as partners in discussing and promoting activities, tools, and strategies for supporting active participation in PCTs. The NIH Collaboratory consists of seven demonstration projects, and seven problem-specific working group 'Cores', aimed at leveraging the data captured in heterogeneous 'real-world' environments for research, thereby improving the efficiency, relevance, and generalizability of trials. Here, we introduce the Collaboratory, focusing on its Phenotype, Data Standards, and Data Quality Core, and present early observations from researchers implementing PCTs within large healthcare systems. We also identify gaps in knowledge and present an informatics research agenda that includes identifying methods for the definition and appropriate application of phenotypes in diverse healthcare settings, and methods for validating both the definition and execution of electronic health records based phenotypes.
Keywords: Clinical Research; Data quality; Phenotyping; Secondary Data Use.
Pragmatic clinical trials embedded in healthcare systems: generalizable lessons from the NIH Collaboratory.BMC Med Res Methodol. 2017 Sep 18;17(1):144. doi: 10.1186/s12874-017-0420-7. BMC Med Res Methodol. 2017. PMID: 28923013 Free PMC article.
Pragmatic (trial) informatics: a perspective from the NIH Health Care Systems Research Collaboratory.J Am Med Inform Assoc. 2017 Sep 1;24(5):996-1001. doi: 10.1093/jamia/ocx016. J Am Med Inform Assoc. 2017. PMID: 28340241 Free PMC article.
Statistical lessons learned for designing cluster randomized pragmatic clinical trials from the NIH Health Care Systems Collaboratory Biostatistics and Design Core.Clin Trials. 2016 Oct;13(5):504-12. doi: 10.1177/1740774516646578. Epub 2016 May 13. Clin Trials. 2016. PMID: 27179253 Free PMC article.
Pragmatic clinical trials offer unique opportunities for disseminating, implementing, and sustaining evidence-based practices into clinical care: Proceedings of a workshop.Healthc (Amst). 2019 Mar;7(1):51-57. doi: 10.1016/j.hjdsi.2018.12.003. Epub 2018 Dec 26. Healthc (Amst). 2019. PMID: 30594497 Free PMC article. Review.
The role of pragmatic clinical trials in the evolution of learning health systems.Trans Am Clin Climatol Assoc. 2014;125:204-16; discussion 217-8. Trans Am Clin Climatol Assoc. 2014. PMID: 25125735 Free PMC article. Review.
Cited by 57 articles
Clinical Text Data in Machine Learning: Systematic Review.JMIR Med Inform. 2020 Mar 31;8(3):e17984. doi: 10.2196/17984. JMIR Med Inform. 2020. PMID: 32229465 Free PMC article. Review.
Polar labeling: silver standard algorithm for training disease classifiers.Bioinformatics. 2020 May 1;36(10):3200-3206. doi: 10.1093/bioinformatics/btaa088. Bioinformatics. 2020. PMID: 32049335 Free PMC article.
Reimagining the research-practice relationship: policy recommendations for informatics-enabled evidence-generation across the US health system.JAMIA Open. 2019 Jan 16;2(1):2-9. doi: 10.1093/jamiaopen/ooy056. eCollection 2019 Apr. JAMIA Open. 2019. PMID: 31984339 Free PMC article.
Discovering novel disease comorbidities using electronic medical records.PLoS One. 2019 Nov 27;14(11):e0225495. doi: 10.1371/journal.pone.0225495. eCollection 2019. PLoS One. 2019. PMID: 31774837 Free PMC article.
Identifying Opioid Use Disorder in the Emergency Department: Multi-System Electronic Health Record-Based Computable Phenotype Derivation and Validation Study.JMIR Med Inform. 2019 Oct 31;7(4):e15794. doi: 10.2196/15794. JMIR Med Inform. 2019. PMID: 31674913 Free PMC article.
- UH2 AT007769/AT/NCCIH NIH HHS/United States
- UH2 AT007788/AT/NCCIH NIH HHS/United States
- UH2 AT007797/AT/NCCIH NIH HHS/United States
- UH2 AT007782/AT/NCCIH NIH HHS/United States
- 1UH2AT007766-01/AT/NCCIH NIH HHS/United States
- 1UH2 AT007784-01/AT/NCCIH NIH HHS/United States
- 1UH2AT007788-01/AT/NCCIH NIH HHS/United States
- UH2 AT007766/AT/NCCIH NIH HHS/United States
- U54 AT007748/AT/NCCIH NIH HHS/United States
- UH2 AT007784/AT/NCCIH NIH HHS/United States
- UH2 AT007755/AT/NCCIH NIH HHS/United States
- 1U54AT007748-01/AT/NCCIH NIH HHS/United States
- 1UH2AT007755-01/AT/NCCIH NIH HHS/United States
- 1UH2AT007782-01/AT/NCCIH NIH HHS/United States
- 1UH2AT007769-01/AT/NCCIH NIH HHS/United States
- 1UH2AT007797-01/AT/NCCIH NIH HHS/United States