The temporal paradox of Hebbian learning and homeostatic plasticity
By Friedemann Zenke, Wulfram Gerstner, Surya Ganguli. 2017
189 citations recorded by the source corpus.
Hebbian plasticity, a synaptic mechanism which detects and amplifies co-activity between neurons, is considered a key ingredient underlying learning and memory in the brain. However, Hebbian plasticity alone is unstable, leading to runaway neuronal activity, and therefore requires stabilization by additional compensatory processes. Traditionally, a diversity of homeostatic plasticity phenomena found in neural circuits are thought to play this role. However, recent modelling work suggests that the slow evolution of homeostatic plasticity, as observed in experiments, is insufficient to prevent instabilities originating from Hebbian plasticity. To remedy this situation, we suggest that homeostatic plasticity is complemented by additional rapid compensatory processes, which rapidly stabilize neuronal activity on short timescales.
Subfields: Neuroscience
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Neuroscience
- Stefan Wermter
- Jun Tani
- Cornelius Weber
- German Ignacio Parisi
- Jordan Guerguiev
- Blake Aaron Richards
- Friedemann Zenke
- Rahaf Aljundi
Citations in the corpus
- Lifelong Learning of Spatiotemporal Representations With Dual-Memory Recurrent Self-Organization (2018, background): “Neurophysiological evidence suggests distributed mechanisms of structural plasticity that promote lifelong memory formation, consolidation, and retrieval in multiple brain areas (Power and Schlaggar, 2016; Zenke et al., 2017a).”
- Deep learning in bioinformatics: introduction, application, and perspective in big data era (2019, background): “Currently, there are three kinds of machine learning methods to deal with the problem based on the neurophysiological theories of human brain [192, 100], which is free of catastrophic forgetting.”
- SupportNet: solving catastrophic forgetting in class incremental learning with support data (2018, background): “The first theory is Hebbian learning (Hebb, 1949) with homeostatic plasticity (Zenke et al. , 2017), which focuses on the mechanism of neurosynaptic plasticity regulating the stability-plasticity balance in the brain.”
- Burst-dependent synaptic plasticity can coordinate learning in hierarchical circuits (2020, background): “It has been 114 well established that such mechanisms exist in real neurons [75, 76].”