Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons

By Christopher D. Fiorillo, Philippe N. Tobler, Wolfram Schultz. 2003

2,033 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

Citations in the corpus

Theory of Mind: A Neural Prediction Problem (2013, neutral): “The central idea of “predictive coding” is that (some) neural responses contain information not about the value of a currently perceived stimulus, but about the difference between the stimulus value and the expected value (Fiorillo et al., 2003; Schultz et al., 1997; Schultz, 2010).”
An fMRI study of reward-related probability learning (2005, result): “This is in accordance with physiology (Fiorillo et al., 2003) and neuroimaging (Aron et al., 2004) data showing that dopamine neurons in the midbrain are sensitive to predictability by varying their firing rates according to uncertainty .”
Reward-motivated learning: mesolimbic activation precedes memory formation. (2006, background): “Electrophysiological research indicates that, after reward-based classical conditioning has occurred, VTA dopamine neurons fire in response to cues that predict reward (Schultz, 1998) and during anticipation of reward (Fiorillo et al., 2003).”
The Catechol-O-Methyltransferase Polymorphism: Relations to the Tonic–Phasic Dopamine Hypothesis and Neuropsychiatric Phenotypes (2004, background): “Neuropsychopharmacology learning, by updating the links between stimulus and response when an expected reward does not occur (Fiorillo et al, 2003; Schultz 2002, 2003).”
Dopamine, Affordance and Active Inference (2012, background): “In particular, it draws on the same notions that link dopamine to the encoding of uncertainty [44] and adaptive responses to changes in neuronal signal to noise levels [45], [46].”
How Prediction Errors Shape Perception, Attention, and Motivation (2012, background): “In line with this account, dopamine neurons have been reported in the primate midbrain that report uncertainty about the predictions (Fiorillo et al., 2003).”
The Teenage Brain (2013, background): “By the end of the experiment, the dopamine neurons are minimally responsive to the actual reward delivery and most responsive to the cue (Fiorillo et al., 2003).”
Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. (2003, background): “While early studies emphasized the role of dopamine in reward-related (hedonic) behavior (Fibiger and Phillips, 1988; Wise and Rompre, 1989) the recent seminal studies by Schultz and colleagues reveal that the primary function of dopamine neurons is to report the mismatch between the animal’s predic”
Cortico-striatal circuits and interval timing: coincidence detection of oscillatory processes. (2004, background): “[52] showing that tonic firing rates of dopamine cells are directly related to the amount of uncertainty a subject has about the outcome of a future event.”
Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. (2007, background): “In one test of this idea, Fiorillo et al. (2003) trained monkeys with different visual cues indicating different probabilities of juice delivery.”
Multiple dopamine functions at different time courses. (2007, methodology): “It covaries with reward probability (Fiorillo et al. 2003, Morris et al. 2004) and the expected value of the reward distribution (Tobler et al. 2005) and is modulated by the motivation of the animal (Satoh et al. 2003), the time course of predictions (Nakahara et al. 2004), and the animal’s choice…”