Speech Perception as a Multimodal Phenomenon
By Lawrence D. Rosenblum. 2008
198 citations recorded by the source corpus.
Speech perception is inherently multimodal. Visual speech (lip-reading) information is used by all perceivers and readily integrates with auditory speech. Imaging research suggests that the brain treats auditory and visual speech similarly. These findings have led some researchers to consider that speech perception works by extracting amodal information that takes the same form across modalities. From this perspective, speech integration is a property of the input information itself. Amodal speech information could explain the reported automaticity, immediacy, and completeness of audiovisual speech integration. However, recent findings suggest that speech integration can be influenced by higher cognitive properties such as lexical status and semantic context. Proponents of amodal accounts will need to explain these results.
Subfields: Experimental and Cognitive Psychology, Social Psychology
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Experimental and Cognitive Psychology
- David J. Lewkowicz
- Ferran Pons
- Laura Bosch
- Asif A. Ghazanfar
- M. Brandon
- Amy H. Tift
- Nicholas J. Minar
- Alice Caplier
In Social Psychology
Citations in the corpus
- Assessing the Role of the ‘Unity Assumption’ on Multisensory Integration: A Review (2017, neutral): “Before accepting the undoubtedly controversial claim that speech really is ‘special’ (see also Saldaña and Rosenblum, 1993; Tuomainen et al., 2005; though see Rosenblum, 2008; Vroomen and Stekelenburg, 2011), a number of alternative explanations for these null results need to be ruled out first.”
- Recognition of Amodal Language Identity Emerges in Infancy (2013, background): “…the audiovisual redundancy of everyday speech, and because of this we not only perceive our interlocutors as unified amodal entities (Fowler, 2004; Rosenblum, 2008; Sumby & Pollack, 1954) but even recognize their specific amodal identity (Kamachi, Hill, Lander, & Vatikiotis-Bateson, 2003; Lachs &…”
- The Natural Statistics of Audiovisual Speech (2009, background): “This common modulation has been previously suggested as a possible amodal metric of speech [15,53].”
- Bilingualism Modulates Infants' Selective Attention to the Mouth of a Talking Face (2015, background): “Studies also show that once reliance on redundant multisensory input begins in infancy, it becomes the default mode of perceptual functioning (Rosenblum, 2008; Stein, 2012).”
- Perception of the multisensory coherence of fluent audiovisual speech in infancy: its emergence and the role of experience. (2015, background): “Social interactions usually involve the use of audiovisual speech (Rosenblum, 2008).”
- The Audio-Visual Temporal Binding Window Narrows In Early Childhood (2013, unknown): “Consistent with this, a number of studies have found that adults and infants do, in fact, engage in a fair amount of lipreading (Lewkowicz & Hansen-Tift, 2012; Rosenblum, 2008; Vatikiotis-Bateson, Eigsti, Yano, & Munhall, 1998; Weikum et al., 2007).”