A coherent computational approach to model bottom-up visual attention

IEEE Trans Pattern Anal Mach Intell. 2006 May;28(5):802-17. doi: 10.1109/TPAMI.2006.86.


Visual attention is a mechanism which filters out redundant visual information and detects the most relevant parts of our visual field. Automatic determination of the most visually relevant areas would be useful in many applications such as image and video coding, watermarking, video browsing, and quality assessment. Many research groups are currently investigating computational modeling of the visual attention system. The first published computational models have been based on some basic and well-understood Human Visual System (HVS) properties. These models feature a single perceptual layer that simulates only one aspect of the visual system. More recent models integrate complex features of the HVS and simulate hierarchical perceptual representation of the visual input. The bottom-up mechanism is the most occurring feature found in modern models. This mechanism refers to involuntary attention (i.e., salient spatial visual features that effortlessly or involuntary attract our attention). This paper presents a coherent computational approach to the modeling of the bottom-up visual attention. This model is mainly based on the current understanding of the HVS behavior. Contrast sensitivity functions, perceptual decomposition, visual masking, and center-surround interactions are some of the features implemented in this model. The performances of this algorithm are assessed by using natural images and experimental measurements from an eye-tracking system. Two adequate well-known metrics (correlation coefficient and Kullbacl-Leibler divergence) are used to validate this model. A further metric is also defined. The results from this model are finally compared to those from a reference bottom-up model.

Publication types

  • Clinical Trial

MeSH terms

  • Artificial Intelligence*
  • Attention / physiology*
  • Color Perception / physiology*
  • Computer Simulation
  • Fixation, Ocular / physiology*
  • Humans
  • Models, Neurological*
  • Pattern Recognition, Visual / physiology*
  • Visual Fields / physiology*