Columbia Open Health Data, clinical concept prevalence and co-occurrence from electronic health records

Sci Data. 2018 Nov 27;5:180273. doi: 10.1038/sdata.2018.273.


Columbia Open Health Data (COHD) is a publicly accessible database of electronic health record (EHR) prevalence and co-occurrence frequencies between conditions, drugs, procedures, and demographics. COHD was derived from Columbia University Irving Medical Center's Observational Health Data Sciences and Informatics (OHDSI) database. The lifetime dataset, derived from all records, contains 36,578 single concepts (11,952 conditions, 12,334 drugs, and 10,816 procedures) and 32,788,901 concept pairs from 5,364,781 patients. The 5-year dataset, derived from records from 2013-2017, contains 29,964 single concepts (10,159 conditions, 10,264 drugs, and 8,270 procedures) and 15,927,195 concept pairs from 1,790,431 patients. Exclusion of rare concepts (count ≤ 10) and Poisson randomization enable data sharing by eliminating risks to patient privacy. EHR prevalences are informative of healthcare consumption rates. Analysis of co-occurrence frequencies via relative frequency analysis and observed-expected frequency ratio are informative of associations between clinical concepts, useful for biomedical research tasks such as drug repurposing and pharmacovigilance. COHD is publicly accessible through a web application-programming interface (API) and downloadable from the Figshare repository. The code is available on GitHub.

Publication types

  • Dataset
  • Research Support, N.I.H., Extramural

MeSH terms

  • Data Analysis
  • Data Mining / methods
  • Databases, Factual*
  • Electronic Health Records* / statistics & numerical data
  • Humans
  • Patients / statistics & numerical data

Associated data

  • figshare/10.6084/m9.figshare.c.4151252