Searchlight analysis: Promise, pitfalls, and potential

By Joset A. Etzel, Jeffrey M. Zacks, Todd S. Braver. 2013

234 citations recorded by the source corpus.

Multivariate pattern analysis (MVPA) is an increasingly popular approach for characterizing the information present in neural activity as measured by fMRI. For neuroimaging researchers, the searchlight technique serves as the most intuitively appealing means of implementing MVPA with fMRI data. However, searchlight approaches carry with them a number of special concerns and limitations that can lead to serious interpretation errors in practice, such as misidentifying a cluster as informative, or failing to detect truly informative voxels. Here we describe how such distorted results can occur, using both schematic illustrations and examples from actual fMRI datasets. We recommend that confirmatory and sensitivity tests, such as the ones prescribed here, should be considered a necessary stage of searchlight analysis interpretation, and that their adoption will allow the full potential of searchlight analysis to be realized.

Subfields: Cognitive Neuroscience

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

Citations in the corpus

Interpreting support vector machine models for multivariate group wise analysis in neuroimaging (2015, neutral): “Consequently, the p-values generated from our method may not suffer from some of the limitations of searchlights described in Etzel et al. (2013) and the limitations of univariate methods described in Davatzikos (2004).”
Prioritizing spatial accuracy in high-resolution fMRI data using multivariate feature weight mapping (2014, methodology): “Previously, the searchlight method has been reviewed critically on the grounds of interpretability and with regard to spatial inaccuracies in the searchlight information maps which obscure the true local information content (Viswanathan et al., 2012; Etzel et al., 2013).”
The Decoding Toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data (2015, background): “In addition, Figure 4A (right panel) illustrates the slight smoothing imposed by the searchlight, where the high SNR spreads the word “TDT” to the neighboring axial slices (Etzel et al., 2013).”
Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates (2015, background): “One possible way to increase the statistical power is to use locally multivariate statistical methods [44, 45, 46, 47, 48], which do not analyze the data one voxel at a time.”
Consolidation alters motor sequence-specific distributed representations (2018, background): “The extent of the searchlight was thus kept to such a local range to limit the inflation of false positive or negative results (Etzel et al., 2004; Etzel et al., 2013).”
A Primer on Pattern-Based Approaches to fMRI: Principles, Pitfalls, and Perspectives. (2015, background): “Also, in an extreme case, a single neuron might contain substantial information that is drowned out by other neurons only contributing noise (e.g., Etzel et al., 2013).”