Orbitofrontal cortex supports behavior and learning using inferred but not cached values
- PMID: 23162000
- PMCID: PMC3592380
- DOI: 10.1126/science.1227489
Orbitofrontal cortex supports behavior and learning using inferred but not cached values
Abstract
Computational and learning theory models propose that behavioral control reflects value that is both cached (computed and stored during previous experience) and inferred (estimated on the fly on the basis of knowledge of the causal structure of the environment). The latter is thought to depend on the orbitofrontal cortex. Yet some accounts propose that the orbitofrontal cortex contributes to behavior by signaling "economic" value, regardless of the associative basis of the information. We found that the orbitofrontal cortex is critical for both value-based behavior and learning when value must be inferred but not when a cached value is sufficient. The orbitofrontal cortex is thus fundamental for accessing model-based representations of the environment to compute value rather than for signaling value per se.
Conflict of interest statement
The authors declare that they have no conflicts of interest related to the data presented in this manuscript.
Figures
Similar articles
-
Does the orbitofrontal cortex signal value?Ann N Y Acad Sci. 2011 Dec;1239:87-99. doi: 10.1111/j.1749-6632.2011.06210.x. Ann N Y Acad Sci. 2011. PMID: 22145878 Free PMC article. Review.
-
The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes.Neuron. 2009 Apr 30;62(2):269-80. doi: 10.1016/j.neuron.2009.03.005. Neuron. 2009. PMID: 19409271 Free PMC article.
-
Model-based learning and the contribution of the orbitofrontal cortex to the model-free world.Eur J Neurosci. 2012 Apr;35(7):991-6. doi: 10.1111/j.1460-9568.2011.07982.x. Eur J Neurosci. 2012. PMID: 22487030 Free PMC article. Review.
-
Lateral Orbitofrontal Inactivation Dissociates Devaluation-Sensitive Behavior and Economic Choice.Neuron. 2017 Dec 6;96(5):1192-1203.e4. doi: 10.1016/j.neuron.2017.10.026. Epub 2017 Nov 16. Neuron. 2017. PMID: 29154127 Free PMC article.
-
Neural Computations Underlying Causal Structure Learning.J Neurosci. 2018 Aug 8;38(32):7143-7157. doi: 10.1523/JNEUROSCI.3336-17.2018. Epub 2018 Jun 29. J Neurosci. 2018. PMID: 29959234 Free PMC article.
Cited by
-
Effects of prior cocaine versus morphine or heroin self-administration on extinction learning driven by overexpectation versus omission of reward.Biol Psychiatry. 2015 May 15;77(10):912-20. doi: 10.1016/j.biopsych.2014.11.017. Epub 2014 Nov 27. Biol Psychiatry. 2015. PMID: 25641634 Free PMC article.
-
Latent-state and model-based learning in PTSD.Trends Neurosci. 2024 Feb;47(2):150-162. doi: 10.1016/j.tins.2023.12.002. Epub 2024 Jan 11. Trends Neurosci. 2024. PMID: 38212163 Review.
-
Value and choice as separable and stable representations in orbitofrontal cortex.Nat Commun. 2020 Jul 10;11(1):3466. doi: 10.1038/s41467-020-17058-y. Nat Commun. 2020. PMID: 32651373 Free PMC article.
-
Temporal Dynamics of the Interaction between Reward and Time Delay during Intertemporal Choice.Front Psychol. 2016 Oct 12;7:1526. doi: 10.3389/fpsyg.2016.01526. eCollection 2016. Front Psychol. 2016. PMID: 27785126 Free PMC article.
-
Back to basics: Making predictions in the orbitofrontal-amygdala circuit.Neurobiol Learn Mem. 2016 May;131:201-6. doi: 10.1016/j.nlm.2016.04.009. Epub 2016 Apr 23. Neurobiol Learn Mem. 2016. PMID: 27112314 Free PMC article. Review.
References
-
- Daw ND, Niv Y, Dayan P. Nature Neuroscience. 2005;8:1704. - PubMed
-
- Cardinal RN, Parkinson JA, Hall G, Everitt BJ. Neuroscience and Biobehavioral Reviews. 2002;26:321. - PubMed
-
- Balleine BW, Daw ND, O’Doherty JP. In: Neuroeconomics: Decision Making and the Brain. Glimcher PW, Camerer CF, Fehr E, Poldrack RA, editors. Elsevier; Amsterdam: 2008. pp. 367–388.
-
- Montague PR, Berns GS. Neuron. 2002;36:265. - PubMed
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
