Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis

By Paul Glimcher. Proceedings of the National Academy of Sciences of the United States of America, 2011

941 citations recorded by the source corpus.

Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience, Molecular Biology

View Paper: https://www.semanticscholar.org/paper/6caac247905c9ed2bb7fcc6697a5c00205b98cc8

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cellular and Molecular Neuroscience

In Cognitive Neuroscience

In Molecular Biology

Citations in the corpus

A genetically-encoded fluorescent sensor enables rapid and specific detection of dopamine in flies, fish, and mice (2018, background): “…area (VTA) to the nucleus accumbens (NAc) regulates a variety of important functions including the reinforcement learning (Daw and Tobler, 2013; Glimcher, 2011; Gonzales et al., 2004), wherein an animal learns to associate an initially neutral sensory cue, such as a short tone burst, with an…”
The feedback-related negativity (FRN) revisited: New insights into the localization, meaning and network organization (2014, background): “A wealth of studies in human and non-human primates showed that these projected RPEs are also processed in the striatum, the orbitofrontal/ventromedial prefrontal cortex (OFC/vmPFC), the dorsal anterior cingulate cortex (dACC) and the dorsolateral prefrontal cortex (dlPFC) and the amygdalae (Gläsche”
Neuronal Reward and Decision Signals: From Theories to Data. (2015, background): “As the backpropagating activation would be small and dispersed, it would appear as ramp only when averaging across multiple trials (183, 388).”
RETHINKING THE EMOTIONAL BRAIN (2012, neutral): “It is therefore of great interest that recent work on the role of dopamine as a reward prediction error signal is beginning to recognize the importance of specific motivational states in modulating the effects of dopamine as a reward prediction error signal (Schultz, 2006; Glimcher, 2011).”
Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development? (2016, background): “…has been linked to reinforcement learning, as it signals eward prediction errors, exhibiting a large phasic DA release when ewards are greater than expected, and firing rates below baseine when rewards are smaller than expected (Bayer and Glimcher, 005; Glimcher, 2011; Schultz et al., 1997).”
Reinforcement Learning and Causal Models (2017, background): “The prediction error interpretation of dopamine has received support from a wide range of studies, too numerous to review here (see Glimcher, 2011).”
Attention, learning and the value of information (2012, background): “A by-now classic series of results suggests that the reward prediction error is encoded by midbrain dopamine cells (Glimcher, 2011; Schultz, 2006; Waelti et al., 2001).”
From prediction error to incentive salience: mesolimbic computation of reward motivation (2012, methodology): “…or stimulus–response pairs, and of recruiting neuronal molecular cascades for memory formation, such as in long-term potentiation or long-term depression of synaptic signaling (Schultz et al., 1997; Hyman et al., 2006; Wise, 2006; Schonberg et al., 2007; Niv & Schoenbaum, 2008; Glimcher, 2011).”
Novelty or Surprise? (2013, background): “…hypothesis of the phasic activity of dopamine neurons, which has received a large amount of empirical support and represents one of the most fruitful integrations between computational and empirical research (Ungless, 2004; Wise, 2004; Schultz, 2007; Graybiel, 2008; Glimcher, 2011).”
Updating dopamine reward signals (2013, background): “Power of negative prediction error signal The positive prediction error response can amount to phasic tripling of impulse rate, whereas the negative response has limited dynamic range owing to the low baseline activity of dopamine neurons (3–5 impulses/s), which might suggest limited negative coding”