Model-Free Temporal-Difference Learning and Dopamine in Alcohol Dependence: Examining Concepts From Theory and Animals in Human Imaging

Abstract

Dopamine potentially unites two important roles: one in addiction, being involved in most substances of abuse including alcohol, and a second one in a specific type of learning, namely model-free temporal-difference reinforcement learning. Theories of addiction have long suggested that drugs of abuse may usurp dopamine's role in learning. Here, we briefly review the preclinical literature to motivate specific hypotheses about model-free temporal-difference learning and then review the imaging evidence in the drug of abuse with the most substantial societal consequences: alcohol. Despite the breadth of the literature, only a few studies have examined the predictions directly, and these provide at best inconclusive evidence for the involvement of temporal-difference learning alterations in alcohol dependence. We discuss the difficulties of testing the theory in humans, make specific suggestions, and close with a focus on the interaction with other learning mechanisms.

Keywords: Alcohol; Computational psychiatry; Cue reactivity; Dopamine; Habits; Model-free; Reinforcement learning; Ventral striatum.