Deep Learning in Medical Image Analysis

Annu Rev Biomed Eng. 2017 Jun 21:19:221-248. doi: 10.1146/annurev-bioeng-071516-044442. Epub 2017 Mar 9.


This review covers computer-assisted analysis of images in the field of medical imaging. Recent advances in machine learning, especially with regard to deep learning, are helping to identify, classify, and quantify patterns in medical images. At the core of these advances is the ability to exploit hierarchical feature representations learned solely from data, instead of features designed by hand according to domain-specific knowledge. Deep learning is rapidly becoming the state of the art, leading to enhanced performance in various medical applications. We introduce the fundamentals of deep learning methods and review their successes in image registration, detection of anatomical and cellular structures, tissue segmentation, computer-aided disease diagnosis and prognosis, and so on. We conclude by discussing research issues and suggesting future directions for further improvement.

Keywords: deep learning; medical image analysis; unsupervised feature learning.

Publication types

  • Review

MeSH terms

  • Algorithms*
  • Diagnostic Imaging / methods*
  • Image Enhancement / methods
  • Image Interpretation, Computer-Assisted / methods*
  • Neural Networks, Computer*
  • Pattern Recognition, Automated / methods*
  • Unsupervised Machine Learning*