Uncertainty, neuromodulation, and attention.

By Angela J. Yu, Peter S. Dayan. Neuron, 2005

1,724 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/68cd87dc4e11543bd3d3aa05aae547cddcb3756b

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

Citations in the corpus

Rational regulation of learning dynamics by pupil–linked arousal systems (2012, methodology): “We quantified the extent to which each new outcome influenced the subsequent prediction as the learning rate in a simple delta-rule model (equation (3))2.”
Medial prefrontal cortex as an action-outcome predictor (2011, background): “The negative surprise signal resembles the unexpected uncertainty signal that has been proposed to drive norepinephrine signal”
The neuro-scientific foundations of the exploration-exploitation dilemma (2010, background): “In addition, the perception of uncertainty has been proposed as an important factor affecting the evaluation of a given situation (McClure, Gilzenrat, & Cohen, 2006; Yu & Dayan, 2005).”
REBUS and the Anarchic Brain: Toward a Unified Model of the Brain Action of Psychedelics (2019, background): “This property has also been attributed to other neuro-modulatory systems, such as noradrenaline and acetylcholine (Yu and Dayan, 2002, 2005), but it may be an especially pronounced feature of the 5-HT2AR system (Carhart-Harris and Nutt, 2017).”
Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules (2018, result): “Indeed, theories of surprise as well as hierarchical Bayesian models predict a faster change of model parameters for surprising stimuli than for known ones (Yu and Dayan, 2005; Nassar et al., 2010; Mathys et al., 2011, 2014; Faraji et al., 2018) similar to, but more general than, the well-known Kalm”
Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration (2007, background): “As the work of Aston- Jones & Cohen (2005) and Yu & Dayan (2005) suggests, ongoing assessments of both uncertainty and utility are likely to be important in regulating this balance.”
Acetylcholine as a neuromodulator: cholinergic signaling shapes nervous system function and behavior (2012, background): “In addition, differences in the time-scale of release at the local microcircuit level further refine the action of ACh in complex behaviors (reviewed in Hasselmo and Giocomo, 2006; Sarter et al., 2009; and Yu and Dayan, 2005).”
Neural systems implicated in delayed and probabilistic reinforcement (2006, result): “It has been suggested that NA neurons encode some aspects of uncertainty in the general sense of making predictions in a given context, in a manner complementary to that of acetylcholine (ACh) (Yu & Dayan, 2005).”
A neural circuit model of flexible sensorimotor mapping: learning and forgetting on multiple timescales. (2007, methodology): “Yu and Dayan (2005) argued that switching strategy is desirable only when errors are most likely to be caused by unpredictable change of cue-response contingencies (unexpected uncertainty), not by unreliability of cueresponse relationship within a block of trials (expected uncertainty).”
Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function (2010, positive): “... critical relay for the sympathoexcitatory efferents of the hypothalamus on their way to the autonomic centers that subserve re-Jones, Rajkowski, & Kubiak, 1997; Clayton, Rajkowski, Cohen, & Aston-Jones, 2004) and computational modeling studies (Gilzenrat, Holmes, Rajkowski, Aston-Jones, & Cohen,”