Can we accurately predict where we look at paintings?

PLoS One. 2020 Oct 9;15(10):e0239980. doi: 10.1371/journal.pone.0239980. eCollection 2020.

Abstract

The objective of this study is to investigate and to simulate the gaze deployment of observers on paintings. For that purpose, we built a large eye tracking dataset composed of 150 paintings belonging to 5 art movements. We observed that the gaze deployment over the proposed paintings was very similar to the gaze deployment over natural scenes. Therefore, we evaluate existing saliency models and propose a new one which significantly outperforms the most recent deep-based saliency models. Thanks to this new saliency model, we can predict very accurately what are the salient areas of a painting. This opens new avenues for many image-based applications such as animation of paintings or transformation of a still painting into a video clip.

MeSH terms

  • Adult
  • Area Under Curve
  • Eye Movements
  • Female
  • Fixation, Ocular / physiology*
  • Humans
  • Male
  • Middle Aged
  • Paintings*
  • ROC Curve
  • Young Adult

Grants and funding

The author(s) received no specific funding for this work.