Predicting Human Brain Activity Associated with the Meanings of Nouns
By Tom Michael Mitchell, Svetlana V. Shinkareva, Andrew Carlson, K. Chang, Vicente L. Malave, Robert A. Mason, Marcel Adam Just. Science, 2008
1,338 citations recorded by the source corpus.
The question of how the human brain represents conceptual knowledge has been debated in many scientific fields. Brain imaging studies have shown that different spatial patterns of neural activation are associated with thinking about different semantic categories of pictures and words (for example, tools, buildings, and animals). We present a computational model that predicts the functional magnetic resonance imaging (fMRI) neural activation associated with words for which fMRI data are not yet available. This model is trained with a combination of data from a trillion-word text corpus and observed fMRI data associated with viewing several dozen concrete nouns. Once trained, the model predicts fMRI activation for thousands of other concrete nouns in the text corpus, with highly significant accuracies over the 60 nouns for which we currently have fMRI data.
Subfields: Cognitive Neuroscience, Cultural Studies
View Paper: https://www.semanticscholar.org/paper/4b75ef161b36957c21fb4e38d9a697bbd87746f1
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Cognitive Neuroscience
- Nikolaus Kriegeskorte
- John-Dylan Haynes
- Gaël Varoquaux
- James V. Haxby
- Jörn Diedrichsen
- Russell A. Poldrack
- Pamela K. Douglas
- K. Müller
In Cultural Studies
- Shinji Nishimoto
- Nikolaus Kriegeskorte
- Alessandro Lenci
- Alexander G. Huth
- Matthew Botvinick
- Russell A. Poldrack
- Jack L. Gallant
- Eliza Bliss-Moreau
Citations in the corpus
- The neural architecture of language: Integrative modeling converges on predictive processing (2020, neutral): “…& Pylkkänen, 2017; Ding et al., 2015; Frank et al., 2015; Henderson et al., 2016; Huth et al., 2016; Lopopolo et al., 2017; Lyu et al., 2019; T. M. Mitchell et al., 2008; Nelson et al., 2017; Pallier et al., 2011; Pereira et al., 2018; Rabovsky et al., 2018; Shain et al., 2020; Wehbe et…”
- Toward a universal decoder of linguistic meaning from brain activation (2018, methodology): “01 using a test based on a normal approximation to the null distribution, with Bonferroni correction for the number of participants (16) and experiments (3); results are shown in Fig.”
- Machine Learning and Radiology (2012, background): “Then they conducted further research on human cognition to try to predict brain behavior under different stimulations (Mitchell et al., 2008).”
- Extracting semantic representations from word co-occurrence statistics: stop-lists, stemming, and SVD (2012, methodology): “…is proving to be relevant for more recent work using corpus-based semantic representations to model brain-imaging data (Levy & Bullinaria, 2012; Mitchell et al., 2008): TOEFL This is the much studied Test of English as a Foreign Language that was originally used by Landauer and Dumais (1997),…”
- Cognitive computational neuroscience (2018, background): “Representational models are often defined on the basis of descriptions of the stimuli, such as labels provided by human observers.(91,98,98,99) In this scenario, a representational model that explains the brain responses in a given region provides, not a brain-computational account, but at least a d”
- The Emergence of Semantics in Neural Network Representations of Visual Information (2018, background): “Both Anderson et al. (2016) and Xu et al. (2016) extend RSA with an additional analysis step, inspired by some of the first work searching for semantics in the brain (Mitchell et al., 2008).”
- Assessing and tuning brain decoders: Cross‐validation, caveats, and guidelines (2016, background): “Decoding power can test if an encoding model describes well multiple facets of stimuli [38, 41].”
- Searchlight analysis: Promise, pitfalls, and potential (2013, positive): “(Carlson et al., 2003; Haxby et al., 2001; Haynes and Rees, 2005; Kamitani and Tong, 2006; Kay et al., 2008; Mitchell et al., 2008).”
- Efficient max-margin multi-label classification with applications to zero-shot learning (2012, result): “We also present results on the fMRI-Words zero-shot learning data set of Mitchell et al. (2008).”
- Machine learning classifiers and fMRI: a tutorial overview (2008, background): “[34] learns a model that predicts fMRI activation for new words, based on their similarity in a space of semantic features to words for which fMRI activation is known.”
- How concepts are encoded in the human brain: A modality independent, category-based cortical organization of semantic knowledge (2016, methodology): “Nonetheless, their more ‘ecological’ nature (e.g., lack of task components in the hemodynamic BOLD response, no artifacts due to verbalization)makes these tasks successfully employed in brain functional protocols (Mitchell et al., 2008; Simmons et al., 2008).”
- Updated MINDS Report on Speech Recognition and Understanding, Part 2 (2009, background): “This would be a complement to “word error rate,” the most prevalent criterion for ASR performance .”
- The processing of verb-argument constructions is sensitive to form, function, frequency, contingency and prototypicality (2014, background): “There are promising developments in categorizing lexical concepts through their commonality in brain imaging that would be exciting to apply also (Just et al. 2010; Mitchell et al. 2008).”
- H. Sapiens Digital: From Digital Immigrants and Digital Natives to Digital Wisdom (2009, background): “Rupert Murdoch, a self-confessed digital immigrant (Murdoch 2005), has also shown digital wisdom in recognizing the need to add digital news-gathering and dissemination tools to his media empire.”