A Neural Substrate of Prediction and Reward

By Wolfram Schultz, Peter S. Dayan, P. R. Montague. 1997

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Neuroscience

Citations in the corpus

Theory of Mind: A Neural Prediction Problem (2013, positive): “The central idea of “predictive coding” is that (some) neural responses contain information not about the value of a currently perceived stimulus, but about the difference between the stimulus value and the expected value (Fiorillo et al., 2003; Schultz et al., 1997; Schultz, 2010).”
Coordinated and Compartmentalized Neuromodulation Shapes Sensory Processing in Drosophila (2015, positive): “Dopaminergic pathways have been investigated extensively as part of a reinforcement system that motivates and modifies many facets of animal behavior (Beninger, 1983; Bromberg-Martin et al., 2010; Redgrave and Gurney, 2006; Schultz et al., 1997; Waddell, 2013; Wise, 2004).”
Multi-agent Reinforcement Learning in Sequential Social Dilemmas (2017, background): “Also, temporal difference predictions have been observed in the brain [41] and this class of reinforcement learning algorithm is seen as a candidate theory of animal habit-learning [42].”
Tag-Trigger-Consolidation: A Model of Early and Late Long-Term-Potentiation and Depression (2008, positive): “under the assumption that reward prediction errors are represented by a dopamine signal”
Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream (2014, background): “These alternative learning schemes might better account for the emergence of neural representations across cortex and may also be optimal for object categorization (Olshausen and Field, 1996; Schultz et al., 1997).”
WRITING MEMORIES WITH LIGHT-ADDRESSABLE REINFORCEMENT CIRCUITRY (2009, background): “Dopamine’s role as a putative aversive reinforcer in fly olfactory learning mirrors, but with reversed polarity, its rewarding role in mammals (Wise and Rompre, 1989; Schultz et al., 1997).”
Brain plasticity through the life span: learning to learn and action video games. (2012, background): “2009) and in the computation of error signals (Schultz et al. 1997).”
as a Robot Controller Neuromodulation as a Robot Controller A Brain-Inspired Strategy for Controlling Autonomous Robots (2009, background): “The 5-HT system responds to risks and threats [6], the ACh system sets a level of attentional effort [7], the DA system drives reward anticipation [8], and the noradrenergic system responds to novel and salient objects [9].”
Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development? (2016, background): “to reinforcement learning, as it signals reward prediction errors, exhibiting a large phasic DA release when rewards are greater than expected, and firing rates below baseline when rewards are smaller than expected (Bayer and Glimcher, 2005; Glimcher, 2011; Schultz et al., 1997).”
Functional anatomy of thalamus and basal ganglia (2002, background): “Basal ganglia and the adjacent structures play a part in predicting future events, reinforcing wanted behaviour and suppressing unwanted behaviour [172] and are in-”