Cortical substrates for exploratory decisions in humans

By Nathaniel D. Daw, John P. O'Doherty, Peter S. Dayan, Ben Seymour, R. J. Dolan. Nature, 2006

2,221 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/7033a4e5775684734eb22be87c5d72caa06983a3

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Evolving neuromodulatory topologies for reinforcement learning-like problems (2007, methodology): “Following, an overview of the algorithm is given.”
Dopamine, Reward Prediction Error, and Economics (2008, result): “As we have discussed, some support for this identification has been found by the work of Bayer and Glimcher (2005), as well as the correlation studies of, for example, Daw et al. (2006).”
Value-Difference Based Exploration: Adaptive Control between Epsilon-Greedy and Softmax (2011, methodology): “In the literature, both policies have been reported as methods for describing the action-selection process in the human brain, where Softmax seems to be the better ﬁt of both [14].”
Adolescent risk-taking in the context of exploration and social influence (2021, methodology): “In the multi-armed bandit problem, exploration can mean switching from one arm to another (Daw et al., 2006)1.”
Neural computations associated with goal-directed choice. (2010, background): “Several human fMRI choice studies have found that BOLD activity in the OFC correlates with chosen values [46,69,70].”
Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration (2007, background): “Daw et al. (2006) compared the behaviour of subjects playing their n-arm bandit task to predictions from each of the three models.”
The neuro-scientific foundations of the exploration-exploitation dilemma (2010, methodology): “We now turn to discuss how each of the key constructs in this paper could be actually observed with the context of one specific task, which can be administered using fMRI techniques: the gambling task (Daw et al., 2006).”
Behavioral and neural properties of social reinforcement learning (2011, background): “…shown that as cues become reliably associated with receipt of a reward, manual responses to these cues quicken over time (O’Doherty et al., 2006; Spicer et al., 2007), while others demonstrate changes in choice behaviors based on reinforcement manipulations (Daw et al., 2006; Li and Daw, 2011).”
Credit Assignment in Multiple Goal Embodied Visuomotor Behavior (2010, background): “This type of action selection has been shown to model human behavior well in a variety of single goal decision making tasks (Daw et al., 2006; Rangel and Hare, 2010).”
Evolutionary and Computational Advantages of Neuromodulated Plasticity (2008, background): “potheses on the neural bases of decisions in humans (Holroyd and Coles, 2002; Daw et al., 2006; Li et al., 2006; Cohen, 2008).”
Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. (2012, methodology): “In the MoE model, we implemented this selection across all levels of actions with the softmax function, commonly used in algorithmic models of this circuitry (Samejima, Ueda, Doya, & Kimura, 2005; Daw et al., 2006; Frank et al., 2007; Doll et al., 2009).”
Cognitive bias as an indicator of animal emotion and welfare: Emerging evidence and underlying mechanisms (2009, background): “, 2005) and the ventromedial prefrontal cortex (Daw et al., 2006).”