Interactions of auditory and visual stimuli in space and time.

By G. Recanzone. 2009

188 citations recorded by the source corpus.

The nervous system has evolved to transduce different types of environmental energy independently, for example light energy is transduced by the retina whereas sound energy is transduced by the cochlea. However, the neural processing of this energy is necessarily combined, resulting in a unified percept of a real-world object or event. These percepts can be modified in the laboratory, resulting in illusions that can be used to probe how multisensory integration occurs. This paper reviews studies that have utilized such illusory percepts in order to better understand the integration of auditory and visual signals in primates. Results from human psychophysical experiments where visual stimuli alter the perception of acoustic space (the ventriloquism effect) are discussed, as are experiments probing the underlying cortical mechanisms of this integration. Similar psychophysical experiments where auditory stimuli alter the perception of visual temporal processing are also described.

Subfields: Cognitive Neuroscience, Experimental and Cognitive Psychology, Sensory Systems

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

In Experimental and Cognitive Psychology

In Sensory Systems

Citations in the corpus

The Curious Incident of Attention in Multisensory Integration: Bottom-up vs. Top-down (2016, unknown): “The precision to encode the location of the stimuli is higher for vision that for audition, while the opposite applies to the processing of temporal information (Recanzone, 2009).”
Recalibration of auditory space following milliseconds of crossmodal discrepancy (2011, background): “In addition to increasing the reliability of perceptual estimates (Ernst and Banks, 2002; Alais and Burr, 2004; Stein and Stanford, 2008), an important functional benefit of having redundant sensory representations is the ability to perform self-maintenance (King, 2009; Recanzone, 2009).”
A Neural Network Model of Ventriloquism Effect and Aftereffect (2012, unknown): “An important question, not completely clarified in the literature yet [32,37] is whether the audio-visual interaction occurs via a direct link between the two areas (as hypothesized in our model) or rather arises via a positive feedback from a higher multimodal area.”
Intersensory binding across space and time: A tutorial review (2013, background): “…2009; Chen, Shi & Müller, 2010; Fendrich & Corballis, 2001; Freeman & Driver, 2008; Getzmann, 2007; MoreinZamir, Soto-Faraco & Kingstone, 2003; Recanzone, 2009; Scheier, Nijhawan & Shimojo, 1999; Sekuler, Sekuler & Lau, 1997; Vroomen & de Gelder, 2004b; Watanabe & Table 1 Selection of…”