Mid-level visual features underlie the high-level categorical organization of the ventral stream

Proc Natl Acad Sci U S A. 2018 Sep 18;115(38):E9015-E9024. doi: 10.1073/pnas.1719616115. Epub 2018 Aug 31.

Abstract

Human object-selective cortex shows a large-scale organization characterized by the high-level properties of both animacy and object size. To what extent are these neural responses explained by primitive perceptual features that distinguish animals from objects and big objects from small objects? To address this question, we used a texture synthesis algorithm to create a class of stimuli-texforms-which preserve some mid-level texture and form information from objects while rendering them unrecognizable. We found that unrecognizable texforms were sufficient to elicit the large-scale organizations of object-selective cortex along the entire ventral pathway. Further, the structure in the neural patterns elicited by texforms was well predicted by curvature features and by intermediate layers of a deep convolutional neural network, supporting the mid-level nature of the representations. These results provide clear evidence that a substantial portion of ventral stream organization can be accounted for by coarse texture and form information without requiring explicit recognition of intact objects.

Keywords: deep neural networks; fMRI; mid-level features; object recognition; ventral stream organization.

MeSH terms

  • Adult
  • Brain Mapping / methods
  • Female
  • Functional Neuroimaging / methods
  • Healthy Volunteers
  • Humans
  • Magnetic Resonance Imaging / methods
  • Male
  • Models, Neurological*
  • Pattern Recognition, Visual / physiology*
  • Photic Stimulation / methods
  • Visual Cortex / physiology*
  • Visual Pathways / physiology*
  • Young Adult