The importance of mixed selectivity in complex cognitive tasks
By Mattia Rigotti, Omri Barak, Melissa R. Warden, Xiao-Jing Wang, Nathaniel D. Daw, Earl K. Miller, Stefano Fusi. 2013
1,630 citations recorded by the source corpus.
Single-neuron activity in the prefrontal cortex (PFC) is tuned to mixtures of multiple task-related aspects. Such mixed selectivity is highly heterogeneous, seemingly disordered and therefore difficult to interpret. We analysed the neural activity recorded in monkeys during an object sequence memory task to identify a role of mixed selectivity in subserving the cognitive functions ascribed to the PFC. We show that mixed selectivity neurons encode distributed information about all task-relevant aspects. Each aspect can be decoded from the population of neurons even when single-cell selectivity to that aspect is eliminated. Moreover, mixed selectivity offers a significant computational advantage over specialized responses in terms of the repertoire of input–output functions implementable by readout neurons. This advantage originates from the highly diverse nonlinear selectivity to mixtures of task-relevant variables, a signature of high-dimensional neural representations. Crucially, this dimensionality is predictive of animal behaviour as it collapses in error trials. Our findings recommend a shift of focus for future studies from neurons that have easily interpretable response tuning to the widely observed, but rarely analysed, mixed selectivity neurons.
Subfields: Artificial Intelligence, Cognitive Neuroscience, Electrical and Electronic Engineering, Neuroscience
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Yoshua Bengio
- Quoc V. Le
- Kyunghyun Cho
- Sergey Levine
- Mohit Bansal
- Ruslan Salakhutdinov
- Jianfeng Gao
- Percy Liang
In Cognitive Neuroscience
- Xiao-Jing Wang
- Srdjan Ostojic
- Rafael Yuste
- Guangyu Robert Yang
- Mark D'Esposito
- John P. Cunningham
- Mehrdad Jazayeri
- Christopher Summerfield
In Electrical and Electronic Engineering
- Rafael Yuste
- Xiao-Jing Wang
- Srdjan Ostojic
- Christopher Summerfield
- Adam Henry Marblestone
- John P. Cunningham
- Guangyu Robert Yang
- Alex Graves
In Neuroscience
- Rafael Yuste
- Xiao-Jing Wang
- Mark D'Esposito
- Todd S. Braver
- Guangyu Robert Yang
- Srdjan Ostojic
- Bradley R. Postle
- K. Tye
Citations in the corpus
- Neural Turing Machines (2014, background): “A recent study quantified delay period activity in prefrontal cortex for a complex, context-dependent task based on measures of “dimensionality” of the population code and showed that it predicted memory performance (Rigotti et al., 2013).”
- Orthogonal representations for robust context-dependent task performance in brains and neural networks (2022, positive): “We do this by drawing upon recent work in machine learning research, which distinguishes among the learning regimes that occur when deep networks are initialized with high-variance (lazy) or low-variance (rich) weights (Rigotti et al., 2013; Fusi et al., 2016; Chizat et al., 2018; Jacot et al., 2018”
- A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex (2020, background): “In our model, each “unit” within our recurrent networks represents a population of neurons, and, as such, inputs to the network were represented by populations of neurons, each of which receives multiple inputs and responds with mixed selectivity as has been observed in PFC (57, 58).”
- Re-evaluating circuit mechanisms underlying pattern separation (2019, positive): “Expansion, when combined with nonlinear mixing, increases the dimensionality of the coding subspace (Rigotti et al., 2013; Fusi et al., 2016).”
- Comparing continual task learning in minds and machines (2018, background): “However, single-cell recordings in the macaque have suggested that after extensive (interleaved) training, neurons in prefrontal cortex form highdimensional representations of task variables that are mixed across the neuronal population (dimension expansion), allowing efficient decoding of relevant ”
- Toward an Integration of Deep Learning and Neuroscience (2016, background): “This question is undergoing extensive study in primates (Warden and Miller, 2007, 2010; Siegel et al., 2009; Rigotti et al., 2013).”
- Towards the neural population doctrine. (2019, background): “Decoding accuracy is more than the sum of its parts Here we focus on the case where population analysis is virtually essential: when neurons have so-called ‘mixed selectivity’ [5,19 ,20].”
- A dataset and architecture for visual reasoning with a working memory (2018, background): “One major goal of this dataset is to build a compositional set of tasks that include variants of many cognitive tasks studied in humans and other animals [32,26,33,34,28,29,30,31] (see also Introduction and Related Work).”
- Demixed principal component analysis of neural population data (2014, background): “…for the analysis of neurophysiological recordings, with many different approaches suggested to deal with it (Brody et al., 2003; Machens et al., 2010; Machens, 2010; Brendel et al., 2011; Rigotti et al., 2013; Pagan and Rust, 2014; Park et al., 2014; Raposo et al., 2014; Cunningham and Yu, 2014).”
- Complementary roles of dimensionality and population structure in neural computations (2020, methodology): “2 Increasing dimensionality allows networks to implement increasingly complex tasks with a single population As expected from previous work [Buonomano and Maass, 2009; Rigotti et al., 2013], we found that tasks of increasing complexity could be implemented with networks consisting of a single popula”
- The Role of Prefrontal Mixed Selectivity in Cognitive Control (2016, background): “Instead, temporal profiles in a population lie in a continuum (Miller and Fusi, 2013; Rigotti et al., 2013).”