The short-latency dopamine signal: a role in discovering novel actions?

By Peter Redgrave, Kevin N. Gurney. 2006

776 citations recorded by the source corpus.

Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cellular and Molecular Neuroscience

In Cognitive Neuroscience

Citations in the corpus

Coordinated and Compartmentalized Neuromodulation Shapes Sensory Processing in Drosophila (2015, positive): “Dopaminergic pathways have been investigated extensively as part of a reinforcement system that motivates and modifies many facets of animal behavior (Beninger, 1983; Bromberg-Martin et al., 2010; Redgrave and Gurney, 2006; Schultz et al., 1997; Waddell, 2013; Wise, 2004).”
Ever-changing cycles of musical pleasure: The role of dopamine and anticipation. (2012, background): “Sensory information is believed to be projected through the superior/inferior colliculus to the dopaminergic neurons in the midbrain (substantianigra comparta and VTA), where the alerting signals are found (Redgrave & Gurney, 2006).”
Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations (2007, methodology): “All other statistical procedures followed those of Experiment 1.”
Midbrain dopamine neurons signal preference for advance information about upcoming rewards (2009, background): “Also, although dopamine neurons have been best studied in the realm of rewards, they can also respond to salient nonrewarding stimuli (Horvitz, 2000; Redgrave and Gurney, 2006; Joshua et al., 2008; Matsumoto and Hikosaka, 2009).”
A Neural Computational Model of Incentive Salience (2009, background): “One influential neurobiological view identifies the predictive error signal, which lies at the core of temporal difference learning, with the firing of dopaminergic neurons projecting to the nucleus accumbens and neostriatum [30,31] (though this notion is not without controversy regarding the causal”
Consciousness without a cerebral cortex: A challenge for neuroscience and medicine (2007, background): “…cortex allows an association of the sensory, motor, and contextual situations immediately previous to this event, so that the animal may develop a “causative theory” of the events that led to this unpredicted stimulus and will become able to generate them in the future (Redgrave & Gurney 2006).”
Dopamine, Affordance and Active Inference (2012, background): “Physiologically, this is compatible with short latency dopamine bursts in the basal ganglia that occur after any salient event, whether rewarding or not [29].”
Habits, rituals, and the evaluative brain. (2008, background): “…et al. 2003, Tobler et al. 2005, Waelti et al. 2001), that they are specialized to respond in relation to positive but not aversive reinforcements, and that they may code uncertainty (Fiorillo et al. 2003, Hsu et al. 2005, Niv et al. 2005, Ungless et al. 2004) or salience (Redgrave & Gurney 2006).”
Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules (2018, background): “Neuromodulators such as dopamine have been identified as the necessary third factor for consolidation (Bailey et al., 2000; Reymann and Frey, 2007; Redondo and Morris, 2011; Lisman, 2017).”
Intrinsically motivated action-outcome learning and goal-based action recall: a system-level bio-constrained computational model. (2013, background): “A related, and currently debated issue, is the nature of the DA signal itself: is this related to (extrinsic) rewards (Schultz, 1998), or phasic stimuli (neutral or rewarding) as in this model (Redgrave and Gurney, 2006), or both?”
Whole-brain mapping of direct inputs to midbrain dopamine neurons. (2012, neutral): “For example, several studies have suggested that dopamine neurons are activated by noxious stimuli (Brischoux et al., 2009; Joshua et al., 2008; Redgrave and Gurney, 2006).”
Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy (2013, background): “(A) BG may establish and maintain associations between stimuli and responses (or even between stimuli, responses and outcomes; Redgrave and Gurney, 2006) to allow context-based response selection.”
Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex (2016, neutral): “the cortex based on associative Hebbian processes [18–20]; and trial-and-error (reinforcement learning) in the basal ganglia based on reward prediction errors computed at level of the striatum and depending on dopamine signals [21, 22].”
Robot Cognitive Control with a Neurophysiologically Inspired Reinforcement Learning Model (2011, result): “In addition to being more parsimonious with respect to robotic implementation of the model, this is consistent with more general theories of dopamine neurons arguing that dopamine neurons respond to any task-relevant stimulus to prevent sensory habituation (Horvitz, 2000; Redgrave and Gurney, 2006).”
Frontiers in Synaptic Neuroscience Synaptic Neuroscience (neutral): “Recently, it has been found that a subpopulation of dopamine neurons also fire in response to aversive stimuli or associated cues (Joshua et al., 2008; Matsumoto and Hikosaka, 2009) suggesting that dopamine can code for multiple external events (Redgrave and Gurney, 2006).”
A Computational Model of Basal Ganglia and its Role in Memory Retrieval in Rewarded Visual Memory Tasks (2009, neutral): “…implementation of the DA firing considers that DA firing only enables the learning of the link between a context (here the content of WM), an action (the response made by the system) and the consequences of this action (here the delivery of reward), as suggested by Redgrave and Gurney (2006).”