Actions and habits: the development of behavioural autonomy

By Anthony D. Dickinson. 1985

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Recurrent Independent Mechanisms (2019, background): “Default Behaviour: Our work is also related to work in behavioural research that deals with two modes of decision making (Dickinson, 1985; Botvinick & Braver, 2015; Kool & Botvinick, 2018): an automatic systems that relies on habits and a controlled system that uses some privileged information for…”
Tonic dopamine: opportunity costs and the control of response vigor (2007, unknown): “This complicated combination of direct motivational sensitivity (of vigor, through the tonic dopamine signal) and insensitivity (of choice, as a result of required learning) turns out to match well the results of experiments on a particular psychological category of “habitual” or “stimulus–response””
Goals and Habits in the Brain (2013, unknown): “This provides a natural account of the emergence of habitual behavior (Dickinson, 1985), as in the latter noise decreases as knowledge accumulates.”
Model-based learning protects against forming habits (2015, unknown): “two instrumental decision systems, one ‘goal-directed’ and another ‘habitual’ (Dickinson, 1985).”
Psychology of Habit. (2016, background): “…learning (RL) research with animals identified a behavioral criterion for detecting habit performance, involving insensitivity to changes in rewarding outcomes (Dickinson 1985), and neuroscience began to identify the brain regions and circuits involved in habitual behavior (Graybiel 1998).”
The successor representation in human reinforcement learning (2016, methodology): “This has been empirically demonstrated by “reward revaluation” studies 7 and latent learning 8 .”
Action understanding as inverse planning. (2009, background): “…the forward problems of planning and reinforcement learning are often divided into model-based and model-free approaches (Daw, Niv, & Day-an, 2005; Doya, 1999; Sutton & Barto, 1998), and there is evidence that the brain has systems corresponding to both (Dickinson, 1985; Schultz et al., 1997).”
Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction (2008, result): “R habits through the weaker relationship between response and outcome that obtains, when compared with ratio schedules (Dickinson 1985).”
Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control (2005, background): “In psychology, such outcome-insensitive behavior is known as 'habitual”
Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates. (2004, background): “With extended training, actions that were originally goal-directed can become ‘automatized’ and habitual [1,41,42,44,45], consistent with this theory.”
Reinforcement Learning and Causal Models (2017, background): “Another line of assault on the law of e↵ect was pursued by Dickinson and his colleagues in the early 1980s (Dickinson, 1985).”
Promoting habit formation (2013, background): “…curve (see Figure 1): initial repetitions caused large increases in automaticity, but with each new repetition, automaticity gains reduced until the behaviour reached its limit of automaticity (for similar findings from the animal learning literature, see e.g., Adams, 1982 and Dickinson, 1985).”
Multiple parallel memory systems in the brain of the rat. (2002, unknown): “The ideas that there are different kinds of memory (Hilgard & Marquis, 1940; Hilgard & Bower, 1966; Amsel, 1980; Horn, 1985; Sherry & Schacter, 1987; Weiskrantz, 1990; Polster, Nadel, & Schacter, 1991; Moscovitch, 1992; Nadel, 1992; Shettleworth, 1993; Moscovitch, 1994; McClelland, McNaughton, & O’R”
Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes (2011, background): “Another theoretical account for competition between the S-R and the A-O systems proposed by Dickinson [67] predicts that competition between the systems depends on the relative value of choices.”