The perception of emotions by ear and by eye

By B. de Gelder, Jean H. M. Vroomen. 2000

669 citations recorded by the source corpus.

Subfields: Cognitive Neuroscience, Experimental and Cognitive Psychology, Social Psychology

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

In Experimental and Cognitive Psychology

In Social Psychology

Citations in the corpus

Assessing the Role of the ‘Unity Assumption’ on Multisensory Integration: A Review (2017, background): “Integrating visual and auditory emotion signals, as compared to speech perception, has received far less attention in studies of multisensory perception (e.g., Massaro and Egan, 1996; de Gelder and Vroomen, 2000; Vroomen et al., 2001; Föcker et al., 2011; Maiworm et al., 2012).”
Visual-haptic cue weighting is independent of modality-specific attention. (2008, neutral): “, 2005 , 2006 ; De Gelder & Vroomen , 2000 ; Helbig & Ernst , 2007a ; Massaro , 1987a , 1987b ; Shams et al .”
Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge (2011, background): “, [51, 52, 148, 102, 133, 214, 101, 230], also in combination with speech.”
Audio-visual integration of emotional cues in song (2008, background): “Facial expressions of speakers also influence judgements of the emotional connotations of speech (de Gelder & Vroomen, 2000; Hietanen, Leppänen, Illi, & Surakka, 2004).”
Describing the emotional states that are expressed in speech (2003, background): “The evidence to date tends to suggest that cues from face and voice carry essentially similar types of information (Mehrabian and Ferris, 1974; de Gelder and Vroomen, 2000a,b; Massaro and Cohen, 2000), but the audio–visual combinations involved may have been too simple to make divergent functions…”
Multisensory perception of the six basic emotions is modulated by attentional instruction and unattended modality (2015, background): “…the immediate crossmodal paradigm (Bertelson and de Gelder, 2004), has been widely used to examine the multisensory perception of the emotion (de Gelder and Vroomen, 2000; Vroomen et al., 2001; Collignon et al., Frontiers in Integrative Neuroscience www.frontiersin.org February 2015 | Volume 9…”
Audiovisual integration of emotional signals from music improvisation does not depend on temporal correspondence. (2010, methodology): “…studies have examined the effect of audiovisual integration on perceived emotions by using face–voice stimuli (Massaro and Egan, 1996; De Gelder and Vroomen, 2000; Kreifelts et al., 2007; Collignon et al., 2008; Campanella and Belin, 2007), showing that under normal conditions the…”
Emotional speech: Towards a new generation of databases (2003, background): “Experiments have begun to consider whether the same is true of emotion (de Gelder and Vroomen, 2000a,b; Massaro and Cohen, 2000), but without access to audio– visual databases, it is difficult to know whether E. Douglas-Cowie et al. / Speech Communication 40 (2003) 33–60 37 the critical…”
The Effects of Visual Beats on Prosodic Prominence: Acoustic Analyses, Auditory Perception and Visual Perception. (2007, methodology): “…children), but incongruencies between acoustic and visual information have also been used successfully with experimental manipulations as in, for instance, McGurk and MacDonald (1976), Fowler and Dekle (1991), Massaro, Cohen, and Smeele (1996) and de Gelder and Vroomen (2000), among many others.”
CREMA-D: Crowd-sourced Emotional Multimodal Actors Dataset (2014, background): “Some studies investigate how audio and video information is integrated and focus particularly on the issues arising when conflicting interpretations of the facial and vocal expression are possible [14], [15].”
Audiovisual integration of emotional signals in voice and face: An event-related fMRI study (2007, background): “doi:10.1016/j.neuroimage.2007.06.020 ( De Gelder and Vroomen, 2000; Ethofer et al., 2006a; Vroomen et al., 2001) one might assume that the audiovisual integration of non-verbal affective information is an automatic process.”
Is cross-modal integration of emotional expressions independent of attentional resources? (2001, background): “De Gelder and Vroomen (1995; 2000) observed that subjects judging the emotional tone of a voice (happy or fearful) were systematically affected by the expression of a static face (e.g., the voice was judged as less fearful if the face was smiling). This crossmodal bias was present even when subjects”
Audiovisual prosody and feeling of knowing (2005, background): “Interestingly, various more recent studies have shown that both modalities inXuence emotion perception of incongruent stimuli, where the visual channel may oVer one emotion (‘happy’) and the auditory channel another (‘sad’) (e.g., de Gelder & Vroomen, 2000; Massaro & Egan, 1996).”