Visual-Patch-Attention-Aware Saliency Detection

IEEE Trans Cybern. 2015 Aug;45(8):1575-86. doi: 10.1109/TCYB.2014.2356200. Epub 2014 Oct 1.

Abstract

The human visual system (HVS) can reliably perceive salient objects in an image, but, it remains a challenge to computationally model the process of detecting salient objects without prior knowledge of the image contents. This paper proposes a visual-attention-aware model to mimic the HVS for salient-object detection. The informative and directional patches can be seen as visual stimuli, and used as neuronal cues for humans to interpret and detect salient objects. In order to simulate this process, two typical patches are extracted individually and in parallel from the intensity channel and the discriminant color channel, respectively, as the primitives. In our algorithm, an improved wavelet-based salient-patch detector is used to extract the visually informative patches. In addition, as humans are sensitive to orientation features, and as directional patches are reliable cues, we also propose a method for extracting directional patches. These two different types of patches are then combined to form the most important patches, which are called preferential patches and are considered as the visual stimuli applied to the HVS for salient-object detection. Compared with the state-of-the-art methods for salient-object detection, experimental results using publicly available datasets show that our produced algorithm is reliable and effective.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Algorithms
  • Attention / physiology*
  • Databases, Factual
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Models, Neurological*
  • Photic Stimulation
  • Visual Perception / physiology*