Dopamine responses comply with basic assumptions of formal learning theory

By P. Waelti, Anthony D. Dickinson, Wolfram Schultz. Nature, 2001

1,014 citations recorded by the source corpus.

Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience, Molecular Biology

View Paper: https://www.semanticscholar.org/paper/79be51d2b7086ddeb4de107b44fbccf452442b92

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cellular and Molecular Neuroscience

In Cognitive Neuroscience

In Molecular Biology

Citations in the corpus

Activation of VTA GABA neurons disrupts reward consumption (2012, positive): “…display a transient high frequency burst of activity in response to the onset of reward predictive cues, followed by low frequency firing following reward delivery (Day et al., 2007; Mirenowicz and Schultz, 1996; Pan et al., 2005; Stuber et al., 2008; Tobler et al., 2005; Waelti et al., 2001).”
Imaging dopamine's role in drug abuse and addiction. (2009, positive): “These, in turn, will trigger DA cells firing with future exposure to stimuli associated with the drug (in expectation of the reward) (Waelti et al., 2001).”
Triadic model of the neurobiology of motivated behavior in adolescence (2005, background): “These processes involve dopamine function, amygdala, ventral and dorsal striatum, orbitofrontal cortex, and medial prefrontal cortex : The error signal has been attributed to dopamine function (Waelti et al. 2001).”
Dopamine signals for reward value and risk: basic and recent data (2010, background): “By contrast, the immediately following response component detects the true nature of the event through its graded activation with reward value [43] and its frequent depression with unrewarded and aversive stimuli [27,29,32,33] (Figure 1E).”
Drugs of abuse and stress trigger a common synaptic adaptation in dopamine neurons. (2003, neutral): “RU486 was administered 30 min prior based learning (Waelti et al., 2001), or (3) be involved in to cocaine administration for the experiments illustrated in Figure signaling “incentive salience,” which in the context of 4C.”
Intrinsic motivation, curiosity, and learning: Theory and applications in educational technologies. (2016, background): “In a famous series of experiments with monkeys, Waelti et al. (2001) showed that monkeys could learn the predictive association between a stimuli and a reward only in situations where prediction errors happened: if the reward was anticipated by other means, then learning was blocked.”
Behavioral and neural analysis of extinction. (2002, background): “Extinction ex-absence of a predicted US (see also Waelti et al., 2001). pression seems to be mediated by GABA (Harris andUnlike the inferior olive, however, the dopaminergic neuWestbrook, 1998) whereas CR expression likely reflectsrons are also responsive to the CS and code for its value the…”
Control of exploitation-exploration meta-parameter in reinforcement learning (2002, background): “Although RL is a machine learning framework, recent studies [46, 62] showed that in a real brain a dopaminergic system including the basal ganglia and the frontal cortex seems to realize a similar learning scheme.”
Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. (2003, background): “…studies by Schultz and colleagues reveal that the primary function of dopamine neurons is to report the mismatch between the animal's prediction and reality (Hollerman and Schultz, 1998; Schultz, 1998; Waelti et al., 2001; Fiorillo et al., 2003) (but see (Redgrave et al., 1999; Horvitz, 2000)).”
Neurocognitive mechanisms of cognitive control: the role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning. (2004, background): “Errors in reward prediction are coded by phasic changes in activity of the midbrain dopamine system: a phasic increase or decrease when ongoing events are suddenly better or worse (respectively ) than expected (Schultz, 2002; Waelti et al., 2001).”
The Neurobiology of Decision: Consensus and Controversy (2009, positive): “Subsequent studies, examining different Pavlovian conditioning paradigms, demonstrated that the qualitative responses of dopaminergic neurons were entirely consistent with this hypothesis (Tobler et al., 2003; Waelti et al., 2001).”