Joint encoding of facial identity, orientation, gaze, and expression in the middle dorsal face area

Proc Natl Acad Sci U S A. 2021 Aug 17;118(33):e2108283118. doi: 10.1073/pnas.2108283118.

Abstract

The last two decades have established that a network of face-selective areas in the temporal lobe of macaque monkeys supports the visual processing of faces. Each area within the network contains a large fraction of face-selective cells. And each area encodes facial identity and head orientation differently. A recent brain-imaging study discovered an area outside of this network selective for naturalistic facial motion, the middle dorsal (MD) face area. This finding offers the opportunity to determine whether coding principles revealed inside the core network would generalize to face areas outside the core network. We investigated the encoding of static faces and objects, facial identity, and head orientation, dimensions which had been studied in multiple areas of the core face-processing network before, as well as facial expressions and gaze. We found that MD populations form a face-selective cluster with a degree of selectivity comparable to that of areas in the core face-processing network. MD encodes facial identity robustly across changes in head orientation and expression, it encodes head orientation robustly against changes in identity and expression, and it encodes expression robustly across changes in identity and head orientation. These three dimensions are encoded in a separable manner. Furthermore, MD also encodes the direction of gaze in addition to head orientation. Thus, MD encodes both structural properties (identity) and changeable ones (expression and gaze) and thus provides information about another animal's direction of attention (head orientation and gaze). MD contains a heterogeneous population of cells that establish a multidimensional code for faces.

Keywords: fMRI-targeted electrophysiology; face-processing systems; facial expression; facial identity; gaze.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Animals
  • Electrophysiological Phenomena
  • Facial Expression*
  • Facial Recognition / physiology*
  • Fixation, Ocular / physiology*
  • Humans
  • Macaca mulatta
  • Magnetic Resonance Imaging
  • Male
  • Pattern Recognition, Visual / physiology
  • Visual Perception / physiology*

Associated data

  • figshare/10.6084/m9.figshare.15087096