Synaptic sampling: A connection between PSP variability and uncertainty explains neurophysiological observations
By Laurence Aitchison, Peter E. Latham. 2015
22 citations recorded by the source corpus.
When an action potential is transmitted to a postsynaptic neuron, a small change in the postsynaptic neuron's membrane potential occurs. These small changes, known as a postsynaptic potentials (PSPs), are highly variable, and current models assume that this variability is corrupting noise. In contrast, we show that this variability could have an important computational role: representing a synapse's uncertainty about the optimal synaptic weight (i.e. the best possible setting for the synaptic weight). We show that this link between uncertainty and variability, that we call synaptic sampling, leads to more accurate estimates of the uncertainty in task relevant quantities, leading to more effective decision making. Synaptic sampling makes four predictions, all of which have some experimental support. First the more variable a synapse is, the more it should change during LTP protocols. Second, variability should increase as the presynpatic firing rate falls. Third, PSP variance should be proportional to PSP mean. Fourth, variability should increase with distance from the cell soma. We provide support for the first two predictions by reanalysing existing datasets, and we find preexisting data in support of the last two predictions.
Subfields: Cellular and Molecular Neuroscience, Cognitive Neuroscience, Probabilistic & Bayesian Methods
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cellular and Molecular Neuroscience
- Demis Hassabis
- Dharshan Kumaran
- Claudia Clopath
- Wulfram Gerstner
- Robert Froemke
- James L. McClelland
- Pierre Yger
In Cognitive Neuroscience
- Demis Hassabis
- Dharshan Kumaran
- Razvan Pascanu
- Andrei A. Rusu
- Sergey Levine
- Joel Veness
- Raia Hadsell
- Claudia Clopath
In Probabilistic & Bayesian Methods
- Joel Veness
- Razvan Pascanu
- Andrei A. Rusu
- Raia Hadsell
- Guillaume Desjardins
- Tiago Ramalho
- Demis Hassabis
- Yoshua Bengio
Citations in the corpus
- Overcoming catastrophic forgetting in neural networks (2016, background): “In this respect, the perspective we offer here aligns with a recent proposal that each synapse not only stores its current weight, but also an implicit representation of its uncertainty about that weight [Aitchison and Latham, 2015].”