Multimodal medical information retrieval with unsupervised rank fusion

Comput Med Imaging Graph. 2015 Jan;39:35-45. doi: 10.1016/j.compmedimag.2014.05.006. Epub 2014 May 23.


Modern medical information retrieval systems are paramount to manage the insurmountable quantities of clinical data. These systems empower health care experts in the diagnosis of patients and play an important role in the clinical decision process. However, the ever-growing heterogeneous information generated in medical environments poses several challenges for retrieval systems. We propose a medical information retrieval system with support for multimodal medical case-based retrieval. The system supports medical information discovery by providing multimodal search, through a novel data fusion algorithm, and term suggestions from a medical thesaurus. Our search system compared favorably to other systems in 2013 ImageCLEFMedical.

Keywords: Assisted query formulation; Data fusion; Medical search; Multimodal retrieval; Search interfaces.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Artificial Intelligence
  • Documentation / methods
  • Information Storage and Retrieval / methods*
  • Medical Subject Headings
  • Multimodal Imaging / methods*
  • Natural Language Processing*
  • Pattern Recognition, Automated / methods
  • PubMed
  • Radiology Information Systems / organization & administration*
  • Subtraction Technique*
  • Terminology as Topic
  • User-Computer Interface
  • Vocabulary, Controlled*