Visual contribution to speech intelligibility in noise

By W. H. Sumby, I. Pollack. 1954

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Early Experience & Multisensory Perceptual Narrowing (2014, background): “Seeing as well as hearing speech is known to increase its salience and comprehension (Rosenblum, Johnson, & Saldana, 1996; Sumby & Pollack, 1954; Summerfield, 1979).”
Effects of separating auditory and visual sources on audiovisual integration of speech (1997, background): “It is well known that watching a speaker’s mouth movements while listening to speech in noisy environments enhances intelligibility (Miller, Heise & Lichten, 1951; Sumby & Pollack, 1954; Walden, Prosek, Montgomery, Scherr & Jones, 1977).”
Multisensory visual-auditory object recognition in humans: a high-density electrical mapping study. (2004, background): “McGurk and MacDonald, 1976), or enhance speech perception in a noisy environment ( Sumby and Pollack, 1954; Campbell and Dodd, 1980; MacLeod and Summerfield, 1990; Thompson, 1995).”
Intersensory Perception at Birth: Newborns Match Nonhuman Primate Faces and Voices. (2010, unknown): “2004; Partan & Marler, 1999; Rowe, 1999; Stein & Meredith, 1993; Sumby & Pollack, 1954;”
The temporal binding window for audiovisual speech: Children are like little adults (2016, background): “Whereas the contribution of vision to speech comprehension is relatively nominal in quiet environments, it is much more robust in noisy and reverberant settings when the auditory signal is masked or distorted (Erber, 1969; Sumby & Pollack, 1954).”
Rules of intersensory integration in spatial scene analysis and speechreading (2001, background): “Not only does lipreading improve intelligibility of speech embedded in noise (Sumby & Pollack, 1954) but it also affects perception in non-degraded listening conditions.”
Correlation versus causation in multisensory perception (2010, unknown): “In situations in which auditory speech is difficult to understand, an additional benefit of seeing the speaker can be shown (Sumby & Pollack, 1954).”
Infants' perception of expressive behaviors: differentiation of multimodal information. (1997, background): “Sumby and Pollack (1954) reported that to watch a speaker's lip is tantamount to a gain of about 20 dB SPL in intensity.”
The Role of Speech-Related Arm/Hand Gestures in Word Retrieval (2001, background): “Rogers also did not adequately control for the 'speech-reading effect'—the well established finding that seeing a speaker's lips contributes to the intelligibility of speech (Sumby and Pollack 1954).”
Rapid Recalibration to Audiovisual Asynchrony (2013, background): “A highly relevant example would be the optimization of speech comprehension (Sumby and Pollack, 1954), which is optimal when visual and auditory signals are perceived as simultaneous.”
Multisensory integration in auditory and auditory-related areas of cortex (2009, background): “Related to perception, enhancement by vision is well known to be larger for weaker vocalizations (Sumby and Pollack, 1954; Ross et al., 2007).”
Perception of intersensory synchrony: A tutorial review (2010, unknown): “The multisensory nature of the world is highly advantageous, because it increases perceptual reliability and saliency, and, as a result, it can enhance learning, discrimination, or the speed of a reaction to the stimulus (e.g., Sumby & Pollack, 1954; Summerfield, 1987).”
The McGurk effect in infants. (1995, background): “Seeing the face of a speaker can significantly embellish a degraded or noisy auditory speech signal so that it functionally raises the signal-to-noise ratio as much as 22 dB ( Sumby and Pollack, 1954; for a review see Rosenblum, Johnson, and Saldana, under review).”
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction (2022, unknown): “Visual cues of speech not only play an essential role in language learning for pre-lingual children (Meltzoff & Moore, 1977; Davies et al., 2008), but also improve speech understanding in noisy environment (Sumby & Pollack, 1954) and provide patients of speech impairment with means of communication.”
Sound alters activity in human V1 in association with illusory visual perception (2006, unknown): “…integration in primate striate cortex”, J. Neurosci., vol. 22, pp.5749 - 5759, 2002 聴覚連合野における聴覚と体性感覚の感覚統合プロセス [7] J.J. Foxe, G.R. Wylie, A. Martinez, C.E. Schroeder, D.C. Javitt, D. Guilfoyle, W. Ritter and M.M. Murray, ”Auditory-somatosensory multisensory processing in auditory association…”