Rules of intersensory integration in spatial scene analysis and speechreading

By Cécile Colin, Monique Radeau, Paul Deltenre, José Morais. 2001

34 citations recorded by the source corpus.

Audiovisual interactions observed in the ventriloquism and McGurk illusions were compared, using the same materials. The ventriloquism effect was estimated through a discordance detection task and the McGurk illusion through an identification task. The stimuli were visually displayed on a screen located in front of the participants’ head and acoustically delivered through one of nine hidden loudspeakers located from straight ahead (0°) to 80° (20° steps) left and right. The speaker’s face was either upright or inverted. The ventriloquism effect was affected by the degree of spatial separation, but unaffected by upright vs. inverted presentation of the face, or by the congruency of the stimuli. The McGurk illusion was of the same size whatever the loudspeaker location but was reduced by face inversion. The differences in the spatial and cognitive rules that govern both interactions are discussed in terms of specific functionality of the underlying mechanisms.

Subfields: Experimental and Cognitive Psychology, Social Psychology

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Experimental and Cognitive Psychology

In Social Psychology

Citations in the corpus

Assessing the Role of the ‘Unity Assumption’ on Multisensory Integration: A Review (2017, background): “For example, Colin et al. (2001) reported that the magnitude of the spatial ventriloquism effect was unaffected by the congruency between visual and auditory speech syllables.”
Spatial and temporal factors during processing of audiovisual speech: a PET study (2004, background): “…activation might apply regardless of relative stimulus location, given psychological findings that McGurk-like effects of lip movements upon speech perception are typically uninfluenced by the relative location of the visual and auditory information (see Bertelson et al., 1994; Colin et al., 2001).”
Multisensory integration of speech signals: the relationship between space and time (2006, unknown): “speech signals occurs regardless of spatial discrepancies between the auditory and visual sources of the signal (Bertelson et al. 1994; Jones and Munhall 1997; Colin et al. 2001).”
Just how important is spatial coincidence to multisensory integration? Evaluating the spatial rule (2013, unknown): “…(2001)81 A facilitation of V discrimination No A, V Yes No 30◦ max. sep. Bertelson et al. (1994)82 McGurk effect No A, V Yes No c. 30◦ max sep. Colin et al. (2001)83 McGurk effect No A, V Yes No c. 30◦ max sep. Fisher and Pylysyn (1994)84 McGurk effect No A, V Yes No c. 30◦ max sep. Jones…”