Information about action outcomes differentially affects learning from self-determined versus imposed choices
- PMID: 32747804
- DOI: 10.1038/s41562-020-0919-5
Information about action outcomes differentially affects learning from self-determined versus imposed choices
Abstract
The valence of new information influences learning rates in humans: good news tends to receive more weight than bad news. We investigated this learning bias in four experiments, by systematically manipulating the source of required action (free versus forced choices), outcome contingencies (low versus high reward) and motor requirements (go versus no-go choices). Analysis of model-estimated learning rates showed that the confirmation bias in learning rates was specific to free choices, but was independent of outcome contingencies. The bias was also unaffected by the motor requirements, thus suggesting that it operates in the representational space of decisions, rather than motoric actions. Finally, model simulations revealed that learning rates estimated from the choice-confirmation model had the effect of maximizing performance across low- and high-reward environments. We therefore suggest that choice-confirmation bias may be adaptive for efficient learning of action-outcome contingencies, above and beyond fostering person-level dispositions such as self-esteem.
Similar articles
-
Learning in anticipation of reward and punishment: perspectives across the human lifespan.Neurobiol Aging. 2020 Dec;96:49-57. doi: 10.1016/j.neurobiolaging.2020.08.011. Epub 2020 Aug 22. Neurobiol Aging. 2020. PMID: 32937209
-
Diminished choice effect on anticipating improbable rewards.Neuropsychologia. 2018 Mar;111:45-50. doi: 10.1016/j.neuropsychologia.2018.01.015. Epub 2018 Feb 2. Neuropsychologia. 2018. PMID: 29355649
-
Hold it! The influence of lingering rewards on choice diversification and persistence.J Exp Psychol Learn Mem Cogn. 2017 Nov;43(11):1752-1767. doi: 10.1037/xlm0000407. Epub 2017 Apr 6. J Exp Psychol Learn Mem Cogn. 2017. PMID: 28383956
-
Optimism as a prior belief about the probability of future reward.PLoS Comput Biol. 2014 May 22;10(5):e1003605. doi: 10.1371/journal.pcbi.1003605. eCollection 2014 May. PLoS Comput Biol. 2014. PMID: 24853098 Free PMC article.
-
Reward-dependent learning in neuronal networks for planning and decision making.Prog Brain Res. 2000;126:217-29. doi: 10.1016/S0079-6123(00)26016-0. Prog Brain Res. 2000. PMID: 11105649 Review.
Cited by
-
Controllability boosts neural and cognitive signatures of changes-of-mind in uncertain environments.Elife. 2022 Sep 13;11:e75038. doi: 10.7554/eLife.75038. Elife. 2022. PMID: 36097814 Free PMC article.
-
Learning when effort matters: neural dynamics underlying updating and adaptation to changes in performance efficacy.Cereb Cortex. 2023 Feb 20;33(5):2395-2411. doi: 10.1093/cercor/bhac215. Cereb Cortex. 2023. PMID: 35695774 Free PMC article.
-
Decision neuroscience and neuroeconomics: Recent progress and ongoing challenges.Wiley Interdiscip Rev Cogn Sci. 2022 May;13(3):e1589. doi: 10.1002/wcs.1589. Epub 2022 Feb 8. Wiley Interdiscip Rev Cogn Sci. 2022. PMID: 35137549 Free PMC article. Review.
-
Control over sampling boosts numerical evidence processing in human decisions from experience.Cereb Cortex. 2022 Dec 15;33(1):207-221. doi: 10.1093/cercor/bhac062. Cereb Cortex. 2022. PMID: 35266973 Free PMC article.
-
Shared Responsibility Decreases the Sense of Agency in the Human Brain.J Cogn Neurosci. 2022 Oct 1;34(11):2065-2081. doi: 10.1162/jocn_a_01896. J Cogn Neurosci. 2022. PMID: 35900857 Free PMC article.
References
-
- Barto, A. G. & Sutton, R. S. Reinforcement Learning: An Introduction (MIT Press, 1998).
-
- Lefebvre, G., Lebreton, M., Meyniel, F., Bourgeois-Gironde, S. & Palminteri, S. Behavioural and neural characterization of optimistic reinforcement learning. Nat. Hum. Behav. 1, 0067 (2017). - DOI
-
- Aberg, K. C., Doell, K. C. & Schwartz, S. Linking individual learning styles to approach-avoidance motivational traits and computational aspects of reinforcement learning. PLoS ONE 11, e0166675 (2016). - DOI
-
- Frank, M. J., Moustafa, A. A., Haughey, H. M., Curran, T. & Hutchison, K. E. Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning. Proc. Natl Acad. Sci. USA 104, 16311–16316 (2007). - DOI
-
- Sharot, T. & Garrett, N. Forming beliefs: why valence matters. Trends Cogn. Sci. 20, 25–33 (2016). - DOI
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Research Materials
