Systematic auditing is essential to debiasing machine learning in biology

Commun Biol. 2021 Feb 10;4(1):183. doi: 10.1038/s42003-021-01674-5.


Biases in data used to train machine learning (ML) models can inflate their prediction performance and confound our understanding of how and what they learn. Although biases are common in biological data, systematic auditing of ML models to identify and eliminate these biases is not a common practice when applying ML in the life sciences. Here we devise a systematic, principled, and general approach to audit ML models in the life sciences. We use this auditing framework to examine biases in three ML applications of therapeutic interest and identify unrecognized biases that hinder the ML process and result in substantially reduced model performance on new datasets. Ultimately, we show that ML models tend to learn primarily from data biases when there is insufficient signal in the data to learn from. We provide detailed protocols, guidelines, and examples of code to enable tailoring of the auditing framework to other biomedical applications.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Animals
  • Bias
  • Data Mining*
  • Databases, Protein
  • Histocompatibility Antigens / metabolism
  • Humans
  • Machine Learning*
  • Pharmaceutical Preparations / chemistry
  • Pharmaceutical Preparations / metabolism
  • Protein Binding
  • Protein Interaction Maps
  • Proteins / chemistry
  • Proteins / metabolism*
  • Proteome*
  • Proteomics*
  • Reproducibility of Results


  • Histocompatibility Antigens
  • Pharmaceutical Preparations
  • Proteins
  • Proteome