A Crowdsourcing Approach to Developing and Assessing Prediction Algorithms for AML Prognosis

PLoS Comput Biol. 2016 Jun 28;12(6):e1004890. doi: 10.1371/journal.pcbi.1004890. eCollection 2016 Jun.


Acute Myeloid Leukemia (AML) is a fatal hematological cancer. The genetic abnormalities underlying AML are extremely heterogeneous among patients, making prognosis and treatment selection very difficult. While clinical proteomics data has the potential to improve prognosis accuracy, thus far, the quantitative means to do so have yet to be developed. Here we report the results and insights gained from the DREAM 9 Acute Myeloid Prediction Outcome Prediction Challenge (AML-OPC), a crowdsourcing effort designed to promote the development of quantitative methods for AML prognosis prediction. We identify the most accurate and robust models in predicting patient response to therapy, remission duration, and overall survival. We further investigate patient response to therapy, a clinically actionable prediction, and find that patients that are classified as resistant to therapy are harder to predict than responsive patients across the 31 models submitted to the challenge. The top two performing models, which held a high sensitivity to these patients, substantially utilized the proteomics data to make predictions. Using these models, we also identify which signaling proteins were useful in predicting patient therapeutic response.

Publication types

  • Comparative Study
  • Evaluation Study
  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms*
  • Amyotrophic Lateral Sclerosis / diagnosis*
  • Amyotrophic Lateral Sclerosis / metabolism
  • Amyotrophic Lateral Sclerosis / therapy*
  • Biomarkers / metabolism
  • Crowdsourcing / methods*
  • Humans
  • Outcome and Process Assessment, Health Care / methods*
  • Proteome / metabolism*
  • Reproducibility of Results
  • Risk Assessment
  • Sensitivity and Specificity
  • Treatment Outcome


  • Biomarkers
  • Proteome