Mesolimbic Confidence Signals Guide Perceptual Learning in the Absence of External Feedback

Elife. 2016 Mar 29;5:e13388. doi: 10.7554/eLife.13388.

Abstract

It is well established that learning can occur without external feedback, yet normative reinforcement learning theories have difficulties explaining such instances of learning. Here, we propose that human observers are capable of generating their own feedback signals by monitoring internal decision variables. We investigated this hypothesis in a visual perceptual learning task using fMRI and confidence reports as a measure for this monitoring process. Employing a novel computational model in which learning is guided by confidence-based reinforcement signals, we found that mesolimbic brain areas encoded both anticipation and prediction error of confidence-in remarkable similarity to previous findings for external reward-based feedback. We demonstrate that the model accounts for choice and confidence reports and show that the mesolimbic confidence prediction error modulation derived through the model predicts individual learning success. These results provide a mechanistic neurobiological explanation for learning without external feedback by augmenting reinforcement models with confidence-based feedback.

Keywords: confidence; feedback; human; neuroscience; perceptual learning; reinforcement learning; ventral striatum.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Anticipation, Psychological
  • Computer Simulation
  • Feedback*
  • Female
  • Humans
  • Learning*
  • Limbic System / physiology*
  • Magnetic Resonance Imaging
  • Models, Neurological
  • Reinforcement, Psychology
  • Young Adult

Grant support

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.