Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI.

By David Badre, Michael J Frank. 2012

209 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

Citations in the corpus

Towards Continual Reinforcement Learning: A Review and Perspectives (2020, background): “There is also significant evidence that substantial hierarchical structure is present in the human learning process (Botvinick et al., 2009; Gershman et al., 2009; Frank and Badre, 2012; Badre and Frank, 2012; Diuk et al., 2013; Botvinick and Weinstein, 2014; Solway et al., 2014; Ribas-Fernandes et ”
The necessity of rostrolateral prefrontal cortex for higher-level sequential behavior (2015, unknown): “This type of output gating has been shown to be important for hierarchical control of this type (Badre and Frank, 2012; Chatham and Badre, 2015; Chatham et al., 2014; Frank and Badre, 2012).”
THE COGNITIVE NEUROSCIENCE OF WORKING MEMORY (2007, background): “Recently, Badre and Frank have provided computational and empirical evidence for the possible mechanisms underlying working memory gating (Badre & Frank, 2012, Frank and Badre 2012, Chatham et al., 2013).”
The Role of Executive Function in Shaping Reinforcement Learning. (2020, background): “There is recent computational, behavioral, and neural evidence that hierarchies of RL computations happen in parallel over more and more abstract types of states and choices, facilitating complex learning abilities [52, 53, 50].”
Why Does Hierarchy (Sometimes) Work So Well in Reinforcement Learning? (2019, background): “Due to its intuitive and biological appeal (Badre & Frank, 2011; Botvinick, 2012), the ﬁeld of HRL has been an active research topic in the machine learning community for many years.”
Hierarchical Reconfiguration of Neurocognitive Task Set Representations Mediates Cognitive Flexibility (2026, unknown): “Previous work on conjunctive representations has largely examined tasks with a single level of rule structure (Kikumoto and Mayr, 2020; Rangel et al., 2023).”
Multiplexed Levels of Cognitive Control through Delta and Theta Neural Oscillations (2024, background): “These parallel loops through the thalamus may update in working memory the different contextual representations (Badre & Frank, 2012; Frank & Badre, 2012), as well as enhance functional cortical connectivity and support the distinct corticocortical synchronization mechanisms that we outlined here…”
Multimodal neuroimaging of hierarchical cognitive control. (2024, background): “…output from working memory, to regulate the interactions among these separate parallel networks (Chatham & Badre, 2015), by supporting rule learning as well as the generalization of control policies (Badre, 2020; Badre et al., 2010; Badre & Frank, 2012; Collins & Frank, 2013; Frank & Badre, 2012).”