Low-dimensional dynamics for working memory and time encoding
By Christopher J. Cueva, A. Saez, Encarni Marcos, A. Genovesio, Mehrdad Jazayeri, Ranulfo Romo, C. Daniel Salzman, Michael N. Shadlen, Stefano Fusi. 2020
137 citations recorded by the source corpus.
Significance A fundamental challenge in studying neural activity that evolves over time is understanding what computational capabilities can be supported by the activity and when these dynamics change to support different computational demands. We develop analyses to parcellate neural activity into computationally distinct dynamical regimes. The regimes we consider each have different computational capabilities, including the ability to keep track of time or preserve information robustly against the flow of time in working memory. We apply our analyses to neural activity and find that low-dimensional trajectories provide a mechanism for the brain to solve the problem of storing information across time while simultaneously retaining the timing information necessary for anticipating events and coordinating behavior. Our decisions often depend on multiple sensory experiences separated by time delays. The brain can remember these experiences and, simultaneously, estimate the timing between events. To understand the mechanisms underlying working memory and time encoding, we analyze neural activity recorded during delays in four experiments on nonhuman primates. To disambiguate potential mechanisms, we propose two analyses, namely, decoding the passage of time from neural data and computing the cumulative dimensionality of the neural trajectory over time. Time can be decoded with high precision in tasks where timing information is relevant and with lower precision when irrelevant for performing the task. Neural trajectories are always observed to be low-dimensional. In addition, our results further constrain the mechanisms underlying time encoding as we find that the linear “ramping” component of each neuron’s firing rate strongly contributes to the slow timescale variations that make decoding time possible. These constraints rule out working memory models that rely on constant, sustained activity and neural networks with high-dimensional trajectories, like reservoir networks. Instead, recurrent networks trained with backpropagation capture the time-encoding properties and the dimensionality observed in the data.
Subfields: Artificial Intelligence, Cognitive Neuroscience, Electrical and Electronic Engineering
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Cognitive Neuroscience
In Electrical and Electronic Engineering
Citations in the corpus
- Orthogonal representations for robust context-dependent task performance in brains and neural networks (2022, neutral): “However, how the neural representations that support context-dependent task performance are acquired remains a key open question for cognitive and neural scientists (Gao and Ganguli, 2015; Mastrogiuseppe andOstojic, 2018; Cueva et al., 2020; Dubreuil et al., 2020; Badre et al., 2021; Freund et al., ”
- The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks (2020, background): “Similarly, the activity of artificial recurrent neural networks optimized to solve cognitive tasks resembles cortical activity in prefrontal (Cueva et al., 2019; Mante, Sussillo, Shenoy, & Newsome, 2013), medial frontal (Wang, Narain, Hosseini, & Jazayeri, 2018), and motor areas (Michaels, Schaffelh”