Hearing lips and seeing voices

By H. McGurk, J. MacDonald. 1976

Subfields: Multimodal Learning, Speech & Audio

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Multimodal Learning

In Speech & Audio

Citations in the corpus

On the Binding Problem in Artificial Neural Networks (2020, background): “This implies that objects can be simultaneously grounded in sensory information from multiple domains, which may help resolve ambiguities (e.g. McGurk Effect; Mcgurk and Macdonald, 1976).”
A Neurorobotic Experiment for Crossmodal Conflict Resolution in Complex Environments * (2018, background): “Widely studied illusions are the spatial ventriloquism effect [7], where the auditory stimulus is perceptually shifted towards the position of the synchronous visual one, and the McGurk effect [8], in which a mismatched audio-visual stimulus of vocalizing a sound leads to the perception of an illuso”
Assessing the Role of the ‘Unity Assumption’ on Multisensory Integration: A Review (2017, background): “According to the argument that speech is special, one should also expect to find a unity effect for other examples of audiovisual speech integration, such as the McGurk effect (McGurk and MacDonald, 1976).”
Early Experience & Multisensory Perceptual Narrowing (2014, methodology): “Here, the task involved the well-known McGurk illusion where subjects are presented with incongruent auditory and visual speech syllables and, depending on the specific syllables presented, subjects either fuse them or combine them (McGurk & MacDonald, 1976).”
Audio-Visual Scene Analysis with Self-Supervised Multisensory Features (2018, background): “Perhaps the most compelling demonstration of this phenomenon is the McGurk effect [5], an illusion in which visual motion of a mouth changes one’s interpretation of a spoken sound(1).”
Measuring Facial Action (2008, background): “It is the output source for speech, and what we hear in part is determined by the lip movements we see with the speech (McGurk & MacDonald 1976).”
Multimedia content processing through cross-modal association (2003, background): “A typical example of this kind is the well-known McGurk effect [2].”
The Role of Audiovisual Speech and Orthographic Information in Nonnative Speech Production (2005, unknown): “Perhaps the most cited demonstration of the role of visual information in speech perception is that by McGurk and MacDonald (1976).”
Perception of intersensory synchrony: A tutorial review (2010, unknown): “In the McGurk effect, a lipread speech token affects the phonetic content of a speech sound that is heard (McGurk & MacDonald, 1976).”
Emotional Responses to Multisensory Environmental Stimuli (2016, background): “…occurs when the auditory component of one sound is paired with the visual component of another sound, leading to the perception of a third sound, McGurk & MacDonald, 1976; or the illusion that a single flash of light is perceived as multiple flashes when it is accompanied by multiple auditory…”
The vibration signal, modulatory communication and the organization of labor in honey bees, Apis mellifera (2004, background): “The modulation of responsiveness to other stimuli may also be a feature of many vertebrate species that operate collectively (McGurk and MacDonald, 1976; Partan and Marler, 1999; Donahoe et al., 2003).”
Acquisition of second-language speech: Effects of visual cues, context, and talker variability (2003, background): “The McGurk effect refers to the influence of a talker’s lip movements on an observ- er’s perception of speech sounds (e.g., McGurk & MacDonald, 1976).”
Do early sensory cortices integrate cross-modal information? (2007, background): “…et al. 2000; Vroomen and de Gelder 2000), or can even change the quality of the sensory percept-like in illusions such as the ventriloquist, the McGurk or the parchment skin (Howard and Templeton 1966; McGurk and MacDonald 1976; Jousmaki and Hari 1998; Shams et al. 2000; Guest et al. 2002).”
The contents of long-term memory and the emergence of knowledge (2009, background): “The best known demonstration of a bimodal integration is the McGurk effect (MacDonald & McGurk, 1978 ; McGurk & MacDonald, 1976 ).”
The Curious Incident of Attention in Multisensory Integration: Bottom-up vs. Top-down (2016, unknown): “Studies using more naturalistic, meaningful stimuli, such as speech fragments and movie clips have indicated that semantic congruence (Cappe et al., 2012; McGurk and Macdonald, 1976; Tuomainen et al., 2005) between visual and auditory stimuli also strongly influences multisensory processing.”