Estrogen modulates reward prediction errors and reinforcement learning

Abstract

Gonadal hormones act throughout the brain and modulate psychiatric symptoms. Yet how hormones influence cognitive processes is unclear. Exogenous 17β-estradiol, the most potent estrogen, modulates dopamine in the nucleus accumbens core, which instantiates reward prediction errors (RPEs), the difference between received and expected reward. Here we show that following endogenous increases in 17β-estradiol, dopamine RPEs and behavioral sensitivity to previous rewards are enhanced, and nucleus accumbens core dopamine reuptake proteins are reduced. Rats adjusted how quickly they initiated trials in a task with varying reward states, balancing effort against expected rewards. Nucleus accumbens core dopamine reflected RPEs that influenced rats' initiation times. Higher 17β-estradiol predicted greater sensitivity to reward states and larger RPEs. Proteomics revealed reduced dopamine transporter expression following 17β-estradiol increases. Finally, knockdown of midbrain estrogen receptors suppressed sensitivity to reward states. Therefore, endogenous 17β-estradiol predicts dopamine reuptake and RPE signaling, and causally dictates the impact of previous rewards on behavior.