Midbrain dopamine neurons encode a quantitative reward prediction error signal.

By Hannah M. Bayer, Paul Glimcher. 2005

1,324 citations recorded by the source corpus.

Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience, Molecular Biology

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cellular and Molecular Neuroscience

In Cognitive Neuroscience

In Molecular Biology

Citations in the corpus

Theory of Mind: A Neural Prediction Problem (2013, neutral): “…example of a neural “error” code: the rate of firing corresponds to any currently “new” (i.e., previously unpredictable) information about the value of coming reward, not to the actual value of any currently perceived stimulus (Bayer and Glimcher, 2005; Nakahara et al., 2004; Tobler et al., 2005).”
Computational models of reinforcement learning: the role of dopamine as a reward signal (2010, background): “Numerous research groups have correlated the activity of DA neurons with the TD error originally proposed by the algorithm (Bayer and Glimcher 2005; Morris et al. 2004; Montague et al. 1996; Nakahara et al. 2004; Roesch et al. 2007; Schultz et al. 1997) and found that it indeed followed the model at”
Neural mechanisms of addiction: the role of reward-related learning and memory. (2006, background): “Bayer & Glimcher (2005) found that the average firing rate of dopamine neurons could encode a reward prediction error of the kind required by reinforcementlearning models if the outcome was better than expected (positive reward–prediction errors).”
Dopamine signals for reward value and risk: basic and recent data (2010, background): “The error response varies quantitatively with the difference between the received reward value and the expected reward value [18-23].”
The debate over dopamine’s role in reward: the case for incentive salience (2007, background): “…models of reinforcement learning, which incorporates time more explicitly into expectations of reward as a series of future events ðV s t ð Þ ¼ h P i¼0 g i r tþ1 iÞ, (Bayer and Glimcher 2005; Daw et al. 2005; Dayan and Balleine 2002; Montague et al. 2004; Schultz 2002, 2006; Tobler et al. 2005a,b).”
Habits, rituals, and the evaluative brain. (2008, background): “…reward value (reward probability and magnitude including negative reward prediction error) and motivational state in a context-dependent manner (Bayer & Glimcher 2005, Morris et al. 2004, Nakahara et al. 2004, Satoh et al. 2003, Tobler et al. 2005, Waelti et al. 2001), that they are…”
Neural differentiation of expected reward and risk in human subcortical structures. (2006, background): “As such, perception of reward and risk may continue even if choice is not affected ( Bayer and Glimcher, 2005 ).”