Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling

Neuroimage. 2010 Apr 1;50(2):644-56. doi: 10.1016/j.neuroimage.2009.11.083. Epub 2009 Dec 5.

Abstract

We dissociated the contributions to learning of four corticostriatal "loops" (interacting striatal and cortical regions): motor (putamen and motor cortex), visual (posterior caudate and visual cortex), executive (anterior caudate and prefrontal cortex), and motivational (ventral striatum and ventromedial frontal cortex). Subjects learned to categorize individual repeated images into one of two arbitrary categories via trial and error. We identified (1) regions sensitive to correct categorization, categorization learning, and feedback valence; (2) regions sensitive to prediction error (violation of feedback expectancy) and reward prediction (expected feedback associated with category response) using reinforcement learning modeling; and (3) directed influences between regions using Granger causality modeling. Each loop showed a unique pattern of sensitivity to each of these factors. Both the motor and visual loops were involved in acquisition of categorization ability: activity during correct categorization increased across learning and was sensitive to reward prediction. However, the posterior caudate received directed influence from visual cortex, whereas the putamen exerted directed influence on motor cortex. The motivational and executive loops were involved in feedback processing: both regions were sensitive to feedback valence, which interacted with learning across scans. However, the motivational loop activity reflected prediction error, whereas executive loop activity reflected reward prediction, consistent with the executive loop role in integrating reward and action. Granger causality modeling found directed influences between striatal and cortical regions within each loop. Across loops, the motor loop exerted directed influence on the executive loop which is consistent with the role of the executive loop in integrating feedback with stimulus-response history.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Brain / physiology*
  • Brain Mapping*
  • Female
  • Humans
  • Image Interpretation, Computer-Assisted
  • Learning / physiology*
  • Magnetic Resonance Imaging
  • Male
  • Models, Neurological*
  • Models, Theoretical