Reinforcement learning in populations of spiking neurons
- PMID: 19219040
- DOI: 10.1038/nn.2264
Reinforcement learning in populations of spiking neurons
Abstract
Population coding is widely regarded as an important mechanism for achieving reliable behavioral responses despite neuronal variability. However, standard reinforcement learning slows down with increasing population size, as the global reward signal becomes less and less related to the performance of any single neuron. We found that learning speeds up with increasing population size if, in addition to global reward, feedback about the population response modulates synaptic plasticity.
Similar articles
-
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules.Front Neural Circuits. 2016 Jan 19;9:85. doi: 10.3389/fncir.2015.00085. eCollection 2015. Front Neural Circuits. 2016. PMID: 26834568 Free PMC article. Review.
-
Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses.Neural Comput. 2019 Dec;31(12):2368-2389. doi: 10.1162/neco_a_01238. Epub 2019 Oct 15. Neural Comput. 2019. PMID: 31614099
-
Neuron as a reward-modulated combinatorial switch and a model of learning behavior.Neural Netw. 2013 Oct;46:62-74. doi: 10.1016/j.neunet.2013.04.010. Epub 2013 May 6. Neural Netw. 2013. PMID: 23708671
-
Code-specific learning rules improve action selection by populations of spiking neurons.Int J Neural Syst. 2014 Aug;24(5):1450002. doi: 10.1142/S0129065714500026. Epub 2013 Dec 5. Int J Neural Syst. 2014. PMID: 24875790
-
Distributed synchrony in a cell assembly of spiking neurons.Neural Netw. 2001 Jul-Sep;14(6-7):815-24. doi: 10.1016/s0893-6080(01)00044-2. Neural Netw. 2001. PMID: 11665773 Review.
Cited by
-
An unsupervised neuromorphic clustering algorithm.Biol Cybern. 2019 Aug;113(4):423-437. doi: 10.1007/s00422-019-00797-7. Epub 2019 Apr 3. Biol Cybern. 2019. PMID: 30944983 Free PMC article.
-
Emergence of task-dependent representations in working memory circuits.Front Comput Neurosci. 2014 May 28;8:57. doi: 10.3389/fncom.2014.00057. eCollection 2014. Front Comput Neurosci. 2014. PMID: 24904395 Free PMC article.
-
A Model of Fast Hebbian Spike Latency Normalization.Front Comput Neurosci. 2017 May 15;11:33. doi: 10.3389/fncom.2017.00033. eCollection 2017. Front Comput Neurosci. 2017. PMID: 28555102 Free PMC article.
-
Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules.Front Neural Circuits. 2016 Jan 19;9:85. doi: 10.3389/fncir.2015.00085. eCollection 2015. Front Neural Circuits. 2016. PMID: 26834568 Free PMC article. Review.
-
How attention can create synaptic tags for the learning of working memories in sequential tasks.PLoS Comput Biol. 2015 Mar 5;11(3):e1004060. doi: 10.1371/journal.pcbi.1004060. eCollection 2015 Mar. PLoS Comput Biol. 2015. PMID: 25742003 Free PMC article.
References
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
