Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual Action

By Bernard W. Balleine, John P. O'Doherty. Neuropsychopharmacology, 2010

1,712 citations recorded by the source corpus.

Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience

View Paper: https://www.semanticscholar.org/paper/a386eb224d6be2ab3f48b015ced299c3929ff0ba

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cellular and Molecular Neuroscience

In Cognitive Neuroscience

Citations in the corpus

Dopamine neurons encoding long-term memory of object value for habitual behavior (2015, neutral): “, 1999) and humans (Balleine and O’Doherty, 2010; Lehéricy et al., 2005).”
From prediction error to incentive salience: mesolimbic computation of reward motivation (2012, background): “To understand these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience.”
Integrating memories to guide decisions (2015, background): “A similar structure and logic are characteristic of a variety of other experiments, from spatial navigation (latent learning, shortcuts) [4] and instrumental conditioning (reward devaluation) [8] to learning in multiplayer games [9] and multistep decision tasks [10].”
Rule abstraction, model-based choice, and cognitive reflection (2016, background): “…behavior can arise from two distinct systems—for example, rule-based versus associative reasoning (Sloman, 1996); goaldirected versus habitual behavior (Balleine & O’Doherty, 2010); intentional versus automatic memory (Jacoby, 1991); model-based versus model-free learning (Daw, Niv, & Dayan, 2005).”
Cognitive Control Predicts Use of Model-based Reinforcement Learning (2014, background): “A number of theories across neuroscience, cognitive psychology, and economics posit that choices may arise from at least two distinct systems (Dolan & Dayan, 2013; Kahneman, 2011; Balleine & O ʼ Doherty, 2009; Daw, Niv, & Dayan, 2005; Loewenstein, 1996).”
Beyond simple reinforcement learning: the computational neurobiology of reward‐learning and valuation (2012, background): “…difﬁculties for a TDRL account because such models are unable to capture the outcome value-sensitive features of goal-directed control (Daw et al. , 2005), nor are they capable of capturing the contingency degradation insensitivity known to be prevalent in habits (Balleine & O’Doherty, 2010).”
Multiple Systems for Value Learning (2014, background): “…psychology of animal learning (Balleine and Dickinson, 1998; Dickinson, 1985), and has more recently been extended to humans and to serve as the foundation for predominant neural and computational accounts of these functions (Balleine and O’Doherty, 2010; Balleine et al., 2008; Daw et al., 2005).”
Disorders of compulsivity: a common bias towards learning habits (2014, positive): “Lesion studies in rodents and imaging studies in humans have particularly pointed to ventromedial prefrontal and orbitofrontal cortices and dorsomedial striatum (dorsal caudate) as supporting goal-directed behaviours (11, 12).”
Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. (2012, background): “Flexible behavior requires cognitive control, or the ability to select mappings between states and actions based on internally maintained representations of context, goals, and anticipated outcomes (Miller and Cohen 2001; O’Reilly and Frank 2006; Balleine and O’Doherty 2010).”