By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism

By Michael J Frank, L. Seeberger, Randall C. O’Reilly. Science, 2004

2,025 citations recorded by the source corpus.

Subfields: Cognitive Neuroscience, Neurology

View Paper: https://www.semanticscholar.org/paper/764fd3bc54709bc77c35df7d081538809065bd19

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

In Neurology

Citations in the corpus

Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex (2016, background): “The subthalamic nucleus is a part of the Bindirect pathway^ of the basal ganglia that is implicated in action inhibition and aversive learning [116, 117].”
Hippocampal Contributions to Model-Based Planning and Spatial Memory (2019, positive): “The appearance of a compensatory shift toward improved model-free learning, which is rarely reported with this task (Frank et al., 2004), indicates that behavior in the ATL patients is not simply noisier and instead is consistent with models invoking multiple, potentially competing, reinforcement-le”
Ten simple rules for the computational modeling of behavioral data (2019, background): “, 2011) and for quantifying the effects of interventions such as drugs, lesions, illness, or experimental conditions (Frank et al., 2004; Lorains et al., 2014; Dowd et al., 2016; Zajkowski et al., 2017; Warren et al., 2017; Wimmer et al., 2018; van Ravenzwaaij et al., 2011).”
A framework for studying the neurobiology of value-based decision making (2008, background): “Frank has proposed a neural-network model for choice between appetitive and aversive habitual valuation”
The Basal Ganglia and Cortex Implement Optimal Decision Making Between Alternative Actions (2007, background): “It has been proposed that these pathways play a critical role in the learning phase, when they block actions that have been punished (Frank et al., 2004).”
Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system (2007, result): “With regard to the issue of whether or not the BG can specifically trigger the toggling process of active maintenance in the PFC, a prominent feature of the PBWM model, accumulating evidence from our group supports this prediction in Parkinson’s patients (Frank et al. 2004), in normals on dopaminerg”
Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making (2006, positive): “Thus whereas previous models omitting the STN were capable of learning complex probabilistic tasks (Frank, 2005a) and produced the correct pattern of DAdependent learning biases (in terms of Go versus NoGo striatal representations; Frank et al., 2004), the networks in those studies were not specific”
Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. (2012, background): “…correlates in functional imaging (McNab and Klingberg 2008; Cools et al. 2008), pharmacological manipulations in patients with Parkinson’s disease (Frank et al. 2004; Cools et al. 2001, 2006; Moustafa et al. 2008; Dagher and Robbins 2009; Palminteri et al. 2009), the combination of pharmacology…”
Dopamine signaling and the distal reward problem (2007, background): “Impairments are observed following lesion of DA neurons [6] and in Parkinson’s disease [7] which is characterized by degeneration of DA neurons.”
Disentangling the Roles of Approach, Activation and Valence in Instrumental and Pavlovian Responding (2011, background): “In the dorsal striatum, there are interdigitated pathways for ‘go’ and ‘nogo’, with the go pathways again linked positively to rewards via dopamine [16,18,55,56].”
Neuronal Reward and Decision Signals: From Theories to Data. (2015, background): “The dichotomous striatal functions go back to learning models showing choice preference mediated by D1, and dispreference by D2, receptor containing striatal neurons and their respectively associated direct and indirect pathways (169).”
FROM REINFORCEMENT LEARNING MODELS OF THE BASAL GANGLIA TO THE PATHOPHYSIOLOGY OF PSYCHIATRIC AND NEUROLOGICAL DISORDERS (2011, methodology): “Simulations using the BG-GNG model have shown that this tendency explains not only Parkinson's disease hypokinetic symptoms, but also a variety of cognitive deficits that accompany this disorde”
The Neurobiology of Decision: Consensus and Controversy (2009, positive): “…mechanisms of decision-making has provided a foundation for understanding aberrant decision-making in addiction, psychiatric disorders, autism and Parkinson’s disease (Bernheim and Rangel, 2004; Chiu et al., 2008a; Chiu et al., 2008b; Frank et al., 2004; King-Casas et al., 2008; Redish, 2004).”