Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions

By Nick E. Barraclough, D. Xiao, Chris L. Baker, M. Oram, David I. Perrett. Journal of Cognitive Neuroscience, 2005

352 citations recorded by the source corpus.

Subfields: Cognitive Neuroscience, Experimental and Cognitive Psychology, Sensory Systems

View Paper: https://www.semanticscholar.org/paper/ffa8d5fd1940e96470769f23db2a0be3d68f28ef

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

In Experimental and Cognitive Psychology

In Sensory Systems

Citations in the corpus

Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments (2008, neutral): “…is known to have bidirectional connections with unisensory auditory, visual, and somatosensory cortices (e.g., see Cusick, 1997; Padberg et al., 2003; Schmahmann and Pandya, 1991) and to contain multisensory neurons (e.g., Bruce et al., 1981; Barraclough et al., 2005; see also Beauchamp , 2005a).”
Understanding the recognition of facial identity and facial expression (2005, background): “There is evidence that STS cells in macaques are sensitive to both visual and auditory components of animated biologically relevant stimuli, including facial signal”
Understanding others' actions and goals by mirror and mentalizing systems: A meta-analysis (2009, neutral): “The aIPS and PMC receive input from the superior temporal sulcus (STS), which contains polysensory neurons that respond to motion from different perceptual modalities (Barraclough et al., 2005).”
Distinct Functional Contributions of Primary Sensory and Association Areas to Audiovisual Integration in Object Categorization (2010, background): “Integration in STS, IPS, and PT depends on subjects’ audiovisual benefit in categorization accuracy Numerous neurophysiological and neuroimaging studies in human and nonhuman primates have implicated the STS and IPS in audiovisual integration (Calvert et al., 2000; Schroeder and Foxe, 2002; Macaluso”
Responses of Prefrontal Multisensory Neurons to Mismatching Faces and Vocalizations (2014, background): “Single-unit recordings in nonhuman primates have demonstrated multisensory responses in the superior temporal sulcus (STS; Barraclough et al., 2005) and auditory cortex (Ghazanfar et al., 2005).”
Mouth and Voice: A Relationship between Visual and Auditory Preference in the Human Superior Temporal Sulcus (2017, background): “…primates demonstrating that single neurons in macaque STS respond to both auditory and visual stimuli (Bruce et al., 1981) and prefer face and voice stimuli in which the seen mouth movement matches the heard vocalization (Barraclough et al., 2005; Ghazanfar et al., 2005; Perrodin et al., 2014).”
Do early sensory cortices integrate cross-modal information? (2007, background): “1), and abundant functional and anatomical studies support crossmodal interactions in these regions (Benevento et al. 1977; Hyvarinen and Shelepin 1979; Bruce et al. 1981; Rizzolatti et al. 1981; Hikosaka et al. 1988; Graziano et al. 1994, 1999; Cusick et al. 1995; Fogassi et al. 1996; Seltzer et al”
Multisensory integration in macaque visual cortex depends on cue reliability (2008, background): “In recent years, these investigations have been extended to a variety of cortical areas and sensory systems, including auditory-visual integration (Barraclough et al., 2005; Bizley et al., 2007; Ghazanfar et al., 2005; Kayser et al., 2008; Romanski, 2007; Sugihara et al., 2006), visual-tactile integ”
Interactions of auditory and visual stimuli in space and time. (2009, background): “Likely candidates include the multisensory areas of the superior temporal sulcus, such as the rostral region of STP, which contains both auditory and visual responses (Barraclough et al., 2005; Poremba et al., 2003; Beauchamp, 2005).”
A computational model of crossmodal processing for conflict resolution (2017, background): “, in the superior temporal sulcus (STS) which is argued to link unimodal representations from cortical areas (visual and auditory cortex) and to account for the association of highly correlated visual and linguistic stimuli [10].”
Sound-Induced Enhancement of Low-Intensity Vision: Multisensory Influences on Human Sensory-Specific Cortices and Thalamic Bodies Relate to Perceptual Enhancement of Visual Detection Sensitivity (2010, background): “…considered as multisensory convergence zones, such as cortically the superior temporal sulcus (STS) (Bruce et al., 1981; Beauchamp et al., 2004; Barraclough et al., 2005), but also areas traditionally considered as modality specific [e.g., visual striate/ extrastriate cortex (Calvert, 2001;…”
Is neocortex essentially multisensory? (2006, background): “Recently, however, Barraclough et al. [ 17 ] measured the integrative properties of single neurons using biologically relevant dynamic stimuli, including vocalizations, ripping paper and human walking.”
Multisensory integration: flexible use of general operations (2014, neutral): “…excitatory inputs from different modalities, i.e., higher-level cortical areas, such as macaque MSTd (as in Ohshiro et al., 2011) or STP (e.g., Barraclough et al., 2005; Dahl et al., 2009) and putatively human STS, or subcortical structures like SC (Stein and Meredith, 1993)—these are what we…”