Multiview locally linear embedding for effective medical image retrieval

PLoS One. 2013 Dec 13;8(12):e82409. doi: 10.1371/journal.pone.0082409. eCollection 2013.

Abstract

Content-based medical image retrieval continues to gain attention for its potential to assist radiological image interpretation and decision making. Many approaches have been proposed to improve the performance of medical image retrieval system, among which visual features such as SIFT, LBP, and intensity histogram play a critical role. Typically, these features are concatenated into a long vector to represent medical images, and thus traditional dimension reduction techniques such as locally linear embedding (LLE), principal component analysis (PCA), or laplacian eigenmaps (LE) can be employed to reduce the "curse of dimensionality". Though these approaches show promising performance for medical image retrieval, the feature-concatenating method ignores the fact that different features have distinct physical meanings. In this paper, we propose a new method called multiview locally linear embedding (MLLE) for medical image retrieval. Following the patch alignment framework, MLLE preserves the geometric structure of the local patch in each feature space according to the LLE criterion. To explore complementary properties among a range of features, MLLE assigns different weights to local patches from different feature spaces. Finally, MLLE employs global coordinate alignment and alternating optimization techniques to learn a smooth low-dimensional embedding from different features. To justify the effectiveness of MLLE for medical image retrieval, we compare it with conventional spectral embedding methods. We conduct experiments on a subset of the IRMA medical image data set. Evaluation results show that MLLE outperforms state-of-the-art dimension reduction methods.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms*
  • Diagnostic Imaging*
  • Humans
  • Information Storage and Retrieval*
  • Principal Component Analysis
  • ROC Curve
  • Sensitivity and Specificity

Grants and funding

This work has been supported in part by the National Natural Science Foundation of China (NSFC) under Grant No.61003017, the Project of Key Laboratory of Software Development Environment under Grant No. SKLSDE-2013ZX-30, and the ARC FT project under Grant No. FT130101457. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.