Opponent interactions between serotonin and dopamine
By Nathaniel D. Daw, Sham M. Kakade, Peter S. Dayan. Neural Networks, 2002
862 citations recorded by the source corpus.
Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience, Molecular Biology
View Paper: https://www.semanticscholar.org/paper/36755a8fdf1859a6cb6b0a148569a1e12357e096
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cellular and Molecular Neuroscience
- Peter S. Dayan
- Yael Niv
- Kent C. Berridge
- Nathaniel D. Daw
- Michael J Frank
- R. J. Dolan
- John P. O'Doherty
- Karl J. Friston
In Cognitive Neuroscience
- Peter S. Dayan
- Nathaniel D. Daw
- Yael Niv
- Michael J Frank
- John P. O'Doherty
- Karl J. Friston
- R. J. Dolan
- Kent C. Berridge
In Molecular Biology
- Yael Niv
- Michael J Frank
- Peter S. Dayan
- Kent C. Berridge
- Kenji Doya
- Nathaniel D. Daw
- J. Cohen
- S. Hyman
Citations in the corpus
- Modulators of decision making (2008, background): “A hypothetical medium of such aversive prediction is serotonergic neuron”
- Temporal difference models describe higher-order learning in humans (2004, background): “In appetitive conditioning the dopamine projection to the ventral striatum is believed to be a critical substrate for this signal, although apart from theoretical speculations about opponent processin”
- Phasic excitation of dopamine neurons in ventral VTA by noxious stimuli (2009, background): “Behavioral experiments show that the termination of an aversive stimulus can act as a reward (26), and therefore might be expected to excite dopamine neurons (27).”
- Tonic dopamine: opportunity costs and the control of response vigor (2007, positive): “ Daw et al. (2002) suggested an opponency between serotonin and dopamine in controlling appetitive and aversive conditioning based on data showing various forms of antagonism between these neuromodulators (e.g., Fletcher and Korth 1999) and in light of long-standing psychological ideas (Konorski 19”
- Neurophysiology of performance monitoring and adaptive behavior. (2014, background): “Behavioral, pharmacological, and anatomical evidence demonstrates close reciprocal interactions between DA and 5-HT (81, 549, 550), and it has been suggested that phasic 5-HT activity might support the learning of aversive values by encoding an aversive prediction error, thus being a mirror image of”
- FROM REINFORCEMENT LEARNING MODELS OF THE BASAL GANGLIA TO THE PATHOPHYSIOLOGY OF PSYCHIATRIC AND NEUROLOGICAL DISORDERS (2011, background): “An alternative or complementary hypothesis is that negative prediction errors may be coded by serotoni”
- Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding (2011, background): “This observation has led to a re-interpretation of previous notions [43] of the opponency between dopamine and serotonin, putting an axis spanning invigoration and inhibition together with spanning reward and punishment [52].”
- Reinforcement learning in the brain (2009, methodology): “This method is closely related to policy improvement methods in dynamic programming (Sutton, 1988), and Williams (1992) and Sutton, Mcallester, Singh, and Mansour (2000) have shown that in some cases the Actor/Critic can be construed as a gradient climbing algorithm for learning a parameterized poli”
- The rostromedial tegmental nucleus (RMTg), a GABAergic afferent to midbrain dopamine neurons, encodes aversive stimuli and inhibits motor responses. (2009, background): “This relationship may lend support to long-standing theoretical ideas regarding opponent processing of affective stimuli (Konorski, 1967; Daw et al., 2002; Fields, 2007; Koob and LeMoal, 2008; Solomon and Corbit, 1974; Matsumoto and Hikosaka, 2007).”
- Metalearning and neuromodulation (2002, background): “…normalized value (1 − γ ) V ( s ( t )) in the discounted TD error (13) by the average reward ¯ r Based on this framework, Daw and colleagues proposed an alternate hypothesis that serotonin represents the predicted average reward ¯ r , thus having an inhibitory effect on dopamine (Daw et al., 2002).”
- Dopamine, uncertainty and TD learning (2005, positive): “Indeed, the latter has directly inspired suggestions that an opponent neurotransmitter, putatively serotonin, be involved in representing and therefore learning the negative prediction errors [20], so that they also have full quarter.”
- Go and no-go learning in reward and punishment: Interactions between affect and effect (2012, background): “Serotonin has been suggested as being involved in coding for aspects of punishment or punishment prediction errors, although this is far from certain (Boureau and Dayan, 2011; Cools et al., 2011; Daw et al., 2002).”
- Dopamine: generalization and bonuses (2002, background): “We ( Daw, Kakade, & Dayan, 2002 ) are exploring opponent process models (Grossberg & Schmajuk, 1987; Solomon & Corbit, 1974) involving an putative opponent interaction between dopamine and the dorsal raphe serotonin system, in the computational context of average-case reinforcement learning (Daw & T”