Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream

By Umut Güçlü, Marcel A. J. van Gerven. 2014

1,002 citations recorded by the source corpus.

Converging evidence suggests that the primate ventral visual pathway encodes increasingly complex stimulus features in downstream areas. We quantitatively show that there indeed exists an explicit gradient for feature complexity in the ventral pathway of the human brain. This was achieved by mapping thousands of stimulus features of increasing complexity across the cortical sheet using a deep neural network. Our approach also revealed a fine-grained functional specialization of downstream areas of the ventral stream. Furthermore, it allowed decoding of representations from human brain activity at an unsurpassed degree of accuracy, confirming the quality of the developed approach. Stimulus features that successfully explained neural responses indicate that population receptive fields were explicitly tuned for object categorization. This provides strong support for the hypothesis that object categorization is a guiding principle in the functional organization of the primate ventral stream.

Subfields: Cognitive Neuroscience, Representation & Self-Supervised Learning, Neuroscience

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

In Representation & Self-Supervised Learning

In Neuroscience

Citations in the corpus

A Neural Algorithm of Artistic Style (2015, background): “(3) To generate a texture that matches the style of a given image (Fig 1, style reconstructions), we use gradient descent from a white noise image to find another image that matches the style representation of the original image.”
Multiagent cooperation and competition with deep reinforcement learning (2015, background): “Convolutional neural networks have become the much needed high-level computational framework against which to contrast data-driven hypotheses of visual processing in the brain [22, 23].”
Large-Scale Gradients in Human Cortical Organization. (2018, neutral): “The framework we advocate emphasizes that an area’s position in the visual processing hierarchy – and thus many of its microstructural and connectional features – is strongly related to its distance from the primary visual area [12,13].”
Neural network models and deep learning - a primer for biologists (2019, background): “(Cadieu et al., 2014; Khaligh-Razavi and Kriegeskorte, 2014; Yamins et al., 2014; Güçlü and van Gerven, 2015; Cichy et al., 2016; Eickenberg et al., 2017; Wen et al., 2017; Nayebi et al., 2018), and yet multiple functional incompatibilities have already been reported (Szegedy et al., 2013; Geirhos…”
If deep learning is the answer, what is the question? (2020, background): “Indeed, the difference in the accuracy of predictions of blood oxygen level-dependent signals between trained networks and untrained networks (that is, those with random weights) is quite small — on the order of 5–10% accuracy difference for most visual regions 19 .”
The present and future of deep learning in radiology. (2019, background): “C Examples of classification framework include detection of fatty liver disease from liver ultrasound images [12, 13, 14], or ovarian cancer detection and risk stratification from ultrasound images [15, 16, 17], or stroke risk stratification using carotid ultrasound [18, 19].”
Deep Neural Networks as a Computational Model for Human Shape Sensitivity (2016, background): “These results expand the growing literature that convnets reflect human visual processing [10,11].”
Seeing it all: Convolutional network layers map the function of the human visual system (2017, methodology): “Previous work has used convolutional networks with fMRI data [23, 24].”
Illusory Motion Reproduced by Deep Neural Networks Trained for Prediction (2018, background): “…of object recognition, stimulus representations developed by the DNNs have been shown to account for neural signals in primates inferior temporal cortex and in fMRI recording data from the human ventral stream (Cadieu et al., 2014; Khaligh-Razavi and Kriegeskorte, 2014; Güçlü and van Gerven, 2015).”
Diverse feature visualizations reveal invariances in early layers of deep neural networks (2018, positive): “Moreover, there is evidence for a considerable degree of similarity between neural representations in DNNs trained on object recognition and the primate visual system [14, 10, 4, 5].”