Predictive Reward Signal of Dopamine Neurons

By A. Cooper, Alan Pickering. 2011

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Short-term plasticity as cause–effect hypothesis testing in distal reward learning (2014, background): “The maximization of reward functions was also implemented in a variety of neural network models (Lin, 1993; Pennartz, 1997; Schultz et al, 1997; Bosman et al, 2004; Xie and Seung, 2004; Florian, 2007; Farries and Fairhall, 2007; Baras and Meir, 2007; Legenstein et al, 2010; Frémaux et al, 2010; Frie”
Hippocampal replay in the awake state: a potential physiological substrate of memory consolidation and retrieval (2011, background): “It is well established that salient events alter hippocampal activity in part through the activation of neuromodulatory inputs such as the dopaminergi”
An intrinsic value system for developing multiple invariant representations with incremental slowness learning (2013, background): “A major deviation from the dopamine as TD-error theory comes from data implicating dopamine in responding to novel salient stimuli [43], [57], even for stimuli that are not predictive of reward.”
Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action (2010, background): “Tremblay L, Schultz W (1999). Relative reward preference in primate orbitofrontal”
Ever-changing cycles of musical pleasure: The role of dopamine and anticipation. (2012, background): “…to depend on a number of neural and psychological factors, including direct sensory input, surprise, novelty, arousal, attention, salience, generalization, and pseudoconditioning (Berridge, 2007; Horvitz, 2000; Redgrave & Gurney, 2006; Redgrave, Prescott, & Gurney, 1999; Schultz, 1998, 2010).”
Dopamine release in the basal ganglia (2011, background): “Phasic activity encodes prediction-related information about rewards or other salient stimuli (Schultz 1998; Matsumoto and Hikosaka 2009), and is thus important for the acquisition of reinforcement seeking behaviors and selection of habitual motor programs independent of reward (Jin and Costa,…”
Burst timing-dependent plasticity of NMDA receptor-mediated transmission in midbrain dopamine neurons: A putative cellular substrate for reward learning (2009, unknown): “1 DA NEURON NMDAR PLASTICITY AND IN VIVO REWARD LEARNING In behaving animals, DA neurons “learn” to respond to inherently neutral environmental cues with synchronized bursts of activity after repeated pairing of cue and reward (or reward-predicting stimuli) (Pan et al., 2005; Schultz, 1998).”
Dissociation of neural networks for anticipation and consumption of monetary and social rewards (2010, unknown): “This is in line with findings linking dopaminergic processes in the midbrain to reward prediction (Schultz, 1998).”
Error and expectation in language learning: The curious absence of mouses in adult speech (2013, background): “…that make assumptions similar to those just described have been successfully applied to the study of decision making, executive function, habitual learning, and response selection in humans (McClure 2003, Montague et al. 2004, Montague et al. 1996, Niv 2009, Schultz 1998, 2006, Waelti et al. 2001).”
How do dopamine neurons represent positive and negative motivational events? (2009, methodology): “We focused on three kinds of neuronal responses: (1) responses elicited by conditioned-stimulus presentation, (2) responses elicited by unconditioned-”
Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli (2009, background): “One states that dopamine neurons are selectively excited by unexpected rewards and reward-predicting stimuli (1); the other states that dopamine neurons are activated by all salient stimuli (33).”
Model-Based and Model-Free Pavlovian Reward Learning: Revaluation, Revision and Revelation (2014, background): “…learned Pavlovian and instrumental cues (Montague et al., 1996; Morris, Nevet, Arkadir, Vaadia, & Bergman, 2006; Roesch, Calu, & Schoenbaum, 2007; Schultz, 1998, 2006; Schultz, Dayan, & Montague, 1997), and dopamine release in animals and humans is linked to rewards and cues in both striatum and…”
From prediction error to incentive salience: mesolimbic computation of reward motivation (2012, background): “temporal difference models (Schultz et al., 1993, 1997; Schultz, 1998; Schultz & Dickinson, 2000; McClure et al., 2003a; Pessiglione et al., 2006; Niv & Schoenbaum, 2008; Glimcher, 2011).”
Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction (2018, background): “…errors of reward learning,” and a similar learning algorithm to that of the cortex seems to be used even if the time from the start of the behavior to the result is relatively long (Schultz, 1998; Schultz and Dickinson, 2000; Keiﬂin and Janak, 2015; Diederen et al., 2017; Nasser et al., 2017).”
A Spiking Neural Model for Stable Reinforcement of Synapses Based on Multiple Distal Rewards (2013, background): “Continuing with this terminology, in Pavlovian learning, reward lags the r-pattern by seconds, yet the reward still yields effective learning (Pavlov, 1927; Hull, 1943; Houk, Davis, & Beiser, 1995; Schultz, 1998; Dayan & Abbott, 2001).”
Branding the brain: A critical review and outlook (2012, background): “, Schultz, W., & Rangel, A. (2008). Dissociating the role of the orbitofrontal cortex and the striatum in the com-”
The Conscious Id (2013, background): “Another classical example is dopamine, which has not only been implicated in neuropsychiatric disorders such as schizophrenia and Parkinsonism but plays a central role in theories of value-dependent learning and emotional behavior ( Schultz, 1998).”