Distinct outcome processing in deterministic and probabilistic reversal learning

Selim Habiby Alaoui; Alexandra Adam-Darqué; Radek Ptak; Armin Schnider

doi:10.1016/j.cortex.2021.04.008

Distinct outcome processing in deterministic and probabilistic reversal learning

Cortex. 2021 Aug:141:224-239. doi: 10.1016/j.cortex.2021.04.008. Epub 2021 May 11.

Authors

Selim Habiby Alaoui¹, Alexandra Adam-Darqué¹, Radek Ptak², Armin Schnider³

Affiliations

¹ Laboratory of Cognitive Neurorehabilitation, Division of Neurorehabilitation, Department of Clinical Neurosciences, University of Geneva, Switzerland.
² Laboratory of Cognitive Neurorehabilitation, Division of Neurorehabilitation, Department of Clinical Neurosciences, University of Geneva, Switzerland; Division of Neurorehabilitation, Department of Clinical Neurosciences, University Hospital of Geneva, Switzerland.
³ Laboratory of Cognitive Neurorehabilitation, Division of Neurorehabilitation, Department of Clinical Neurosciences, University of Geneva, Switzerland; Division of Neurorehabilitation, Department of Clinical Neurosciences, University Hospital of Geneva, Switzerland. Electronic address: armin.schnider@hcuge.ch.

PMID: 34098424
DOI: 10.1016/j.cortex.2021.04.008

Abstract

Anticipations that fail to happen are important drivers of behavioral adaptation. Their processing appears to depend on the context. In a deterministic environment, where a stimulus unequivocally predicts the outcome, processing of absent outcomes involves the posterior orbitofrontal cortex (OFC). Failure has been linked to reality confusion with confabulations and disorientation. In a probabilistic environment, absent outcomes appear to be processed by the anterior cingulate cortex (ACC) rather than the OFC. Failure has been associated with poor decision making and schizophrenia. These data suggest different mechanisms depending on the context. Here, healthy human subjects made two formally similar reversal learning tasks, but one with deterministic, the other with probabilistic instructions. Brain activity was monitored using high-density electroencephalography. We found that in the deterministic task, negative outcomes, which unequivocally call for a behavioral switch, induced a distinct frontal potential at 200-300 msec. Computational modeling indicated a strong association of evoked potentials with prediction error, surprise, and behavioral adaptation. In the probabilistic task, where behavioral adaptation follows the cumulated processing of outcomes, negative outcomes evoked potentials that were associated with prediction error and surprise, but had a weak link with subsequent behavior. Outcome processing in the probabilistic task induced stronger activation than the deterministic task of an extended network including the ACC, OFC and striatum at 300-400 msec. In both tasks, negative outcomes were processed differently from positive outcomes at 400-600 msec, possibly reflecting updating of the outcome record. We conclude that the brain disposes of at least two distinct systems processing outcomes with unequivocal or ambiguous behavioral significance. These systems differ along behavioral, clinical, electrophysiological and anatomical dimensions.

Keywords: Behavioral extinction; Judgment; Monitoring; Orbitofrontal reality filtering; Outcome processing; Prediction error.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Brain
Electroencephalography
Evoked Potentials*
Frontal Lobe
Humans
Reversal Learning*