Dopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning

Hong, Simon and Hikosaka, Okihide (2011) Dopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning. Frontiers in Behavioral Neuroscience, 5. ISSN 1662-5153

[thumbnail of pubmed-zip/versions/1/package-entries/fnbeh-05-00015/fnbeh-05-00015.pdf] Text
pubmed-zip/versions/1/package-entries/fnbeh-05-00015/fnbeh-05-00015.pdf - Published Version

Download (1MB)

Abstract

The basal ganglia are thought to play a crucial role in reinforcement learning. Central to the learning mechanism are dopamine (DA) D1 and D2 receptors located in the cortico-striatal synapses. However, it is still unclear how this DA-mediated synaptic plasticity is deployed and coordinated during reward-contingent behavioral changes. Here we propose a computational model of reinforcement learning that uses different thresholds of D1- and D2-mediated synaptic plasticity which are antagonized by DA-independent synaptic plasticity. A phasic increase in DA release caused by a larger-than-expected reward induces long-term potentiation (LTP) in the direct pathway, whereas a phasic decrease in DA release caused by a smaller-than-expected reward induces a cessation of long-term depression, leading to LTP in the indirect pathway. This learning mechanism can explain the robust behavioral adaptation observed in a location-reward-value-association task where the animal makes shorter latency saccades to reward locations. The changes in saccade latency become quicker as the monkey becomes more experienced. This behavior can be explained by a switching mechanism which activates the cortico-striatal circuit selectively. Our model also shows how D1- or D2-receptor blocking experiments affect selectively either reward or no-reward trials. The proposed mechanisms also explain the behavioral changes in Parkinson’s disease.

Item Type: Article
Subjects: ScienceOpen Library > Biological Science
Depositing User: Managing Editor
Date Deposited: 22 Mar 2023 05:58
Last Modified: 14 Sep 2024 04:05
URI: http://scholar.researcherseuropeans.com/id/eprint/819

Actions (login required)

View Item
View Item