Tonic dopamine: opportunity costs and the control of response vigor

By Yael Niv, Nathaniel D. Daw, Daphna Joel, Peter S. Dayan. Psychopharmacology, 2007

1,123 citations recorded by the source corpus.

Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience

View Paper: https://www.semanticscholar.org/paper/e1625352c7b6e275ec9a63984a5af25a98032671

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cellular and Molecular Neuroscience

In Cognitive Neuroscience

Citations in the corpus

Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding (2011, background): “Dopamine may have a dominant influence in this: it is both known to be released, and influential, in some aversive settings [82–85] and has a more evident relationship to vigour [33,34].”
From prediction error to incentive salience: mesolimbic computation of reward motivation (2012, background): “…may still believe that dopamine causes pleasure, the majority opinion in the field seems no longer to accept the dopamine = hedonia view (Wise, 2006; Barbano & Cador, 2007; Berridge, 2007; Daw, 2007; Nicola, 2007; Niv et al., 2007; Salamone et al., 2007; Koob & Volkow, 2010; Aarts et al., 2011).”
Goals and Habits in the Brain (2013, positive): “The model-free controller’s uncertainty about the relative values of the action becomes a measure of the potential benefit; and the opportunity cost of the time of calculation (quantified by the prevailing average reward rate (Niv et al., 2007) is a measure of the cost.”
Model-Based and Model-Free Pavlovian Reward Learning: Revaluation, Revision and Revelation (2014, background): “The average reward reports the opportunity cost for the passage of time, and has thus been interpreted as being key to the instrumental choice of vigor (Niv et al., 2007).”
Dopamine in motivational control: rewarding, aversive, and alerting (2010, background): “Indeed, DA neurons are critical in motivating effort to achieve high-value goals and in translating knowledge of task demands into reliable motor performance (Berridge and Robinson, 1998; Mazzoni et al., 2007; Niv et al., 2007; Salamone et al., 2007).”
The roles of the amygdala in the affective regulation of body, brain, and behaviour (2010, background): “Moreover, tonic DA in NAcc seems to modulate organisms’ vigor, that is the number of actions that the animal performs in a given amount of time and the involvement of energy spent in their execution (Niv et al., 2006; Floresco, 2007).”
Go and no-go learning in reward and punishment: Interactions between affect and effect (2012, background): “, 2009), this pattern is consistentwith a suggestion that dopamine plays a role in action preparation and invigoration (Berridge and Robinson, 1998; Niv et al., 2007; Salamone et al., 2007), a role complementary to its established role in representing a reward prediction error.”
Modulators of decision making (2008, background): “In deciding between actions with less-than-average rewards, an action with smaller reward in shorter time can be more appropriate because it allows moving on to the next action earlier, resulting in an apparently impulsive choic”
Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease (2010, background): “Thus, the relatively preserved motivation- and emotion-based selections made within intrinsic microcircuits of the limbic territories of the basal ganglia should still be able to guide and energiz”
Reinforcement learning: the good, the bad and the ugly. (2008, background): “It also inspired a new set of modeling investigations into free operant choice tasks, in which subjects are free to execute actions at times of their own choosing, and the dependent variables are quantities such as the rates of responding [70,71].”
Multiple Forms of Value Learning and the Function of Dopamine (2009, background): “Other, more selective, effects of Pavlovian values on choice (e.g. that illustrated in Figure 2) go beyond the scope of the reinforcement learning models discussed here (but see Niv et al., 2007).”
Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes (2011, background): “[19], as in our model, animals make a balance between the cost and benefit of acting quickly.”