The Handbook of Multisensory Processes

2004

A reference work for the emerging field of multisensory integration, covering multidisciplinary research that goes beyond the traditional "sense-by-sense" approach and recognizes that perception is fundamentally a multisensory experience. This landmark reference work brings together for the first time in one volume the most recent research from different areas of the emerging field of multisensory integration. After many years of using a modality-specific "sense-by-sense" approach, researchers across different disciplines in neuroscience and psychology now recognize that perception is fundamentally a multisensory experience. To understand how the brain synthesizes information from the different senses, we must study not only how information from each sensory modality is decoded but also how this information interacts with the sensory processing taking place within other sensory channels. The findings cited in The Handbook of Multisensory Processes suggest that there are broad underlying principles that govern this interaction, regardless of the specific senses involved. The book is organized thematically into eight sections; each of the 55 chapters presents a state-of-the-art review of its topic by leading researchers in the field. The key themes addressed include multisensory contributions to perception in humans; whether the sensory integration involved in speech perception is fundamentally different from other kinds of multisensory integration; multisensory processing in the midbrain and cortex in model species, including rat, cat, and monkey; behavioral consequences of multisensory integration; modern neuroimaging techniques, including EEG, PET, and fMRI, now being used to reveal the many sites of multisensory processing in the brain; multisensory processes that require postnatal sensory experience to emerge, with examples from multiple species; brain specialization and possible equivalence of brain regions; and clinical studies of such breakdowns of normal sensory integration as brain damage and synesthesia. Bradford Books imprint

Citations in the corpus

• Continual Lifelong Learning with Neural Networks: A Review (2018, background): “Towards Autonomous Agents Humans have the extraordinary ability to learn and progressively fine-tune their sensorimotor skills in a lifelong manner (Tani, 2016; Bremner et al., 2012; Calvert et al., 2004).”
• Spatial heterogeneity of cortical receptive fields and its impact on multisensory interactions. (2008, background): “…and inverse effectiveness principles of multisensory integration have provided an excellent predictive framework for understanding the consequences of multisensory interactions from the level of the single neuron to behavioral and perceptual processes (Calvert et al. 2004; Stein and Meredith 1993).”
• A review of verbal and non-verbal human-robot interactive communication (2014, background): “The McGurk effect is an instance of so-called multi-sensory perception phenomena [133], which also include other interesting cases such as the rubber hand illusion [134].”
• Spatiotemporal architecture of cortical receptive fields and its impact on multisensory interactions (2009, unknown): “As alluded to in the introduction, the nature of multisensory interactions at the level of the single neuron and beyond depend critically on the spatial, temporal and inverse effectiveness principles of multisensory integration (Stein and Meredith 1993; Calvert et al. 2004).”
• A visual analytics approach to understanding cycling behaviour (2012, unknown): “The grid comprises of rectangular/hexahedron cells; the base grid resolution is 3 cells per radius (cpR) and 6 levels of refinement (or 5 for the 3D case) are sequentially applied in order to achieve the desired resolution of 192cpR (or 96cpR).”
• Early experience determines how the senses will interact. (2007, background): “It has been demonstrated in every species tested, and it is clearly adaptive under widely differing environmental circumstances (Calvert et al. 2004; Stein and Meredith 1993).”
• The brain uses single-trial multisensory memories to discriminate without awareness (2005, unknown): “Likewise, increasing evidence indicates that the LOC and surrounding cortices play a substantial role in auditory–visual as well as somatosensory–visual multisensory interactions, particularly with object stimuli (reviewed in Amedi et al., in press; Calvert et al., 2004).”
• The effect of synesthetic associations between the visual and auditory modalities on the Colavita effect (2015, background): “The first are structural factors, referring to inherent properties of the stimulus such as temporal and spatial contiguity between sensory inputs of different modalities (Calvert et al. 2004).”
• Feeling the way: Notes toward a haptic phenomenology of distance running and scuba diving (2011, background): “The inter-relatedness of the senses should also be borne in mind, for rarely do we experience singular sensory modality, but rather ‘multisensory processes’ (Calvert et al., 2004).”
• Semantic congruency and the Colavita visual dominance effect (2008, background): “contributing to multisensory integration (Calvert et al. 2004; Rosenblum et al. 1996); the time-varying relationship between the auditory and visual events contributes to the structure, or the physical relationship, between the auditory and visual stimuli.”
• The Integrated Development of Sensory Organization (2011, background): “We now know that the senses function in concert even in very early infancy and that young brains are organized to use the information they derive from the various sensory systems to enhance the likelihood that objects and events will be detected rapidly, identified correctly, and responded to approp”
• The role of intersensory redundancy in early perceptual, cognitive, and social development (2012, background): “…of research on the neural architecture and neural processes involved in intersensory functioning (for overviews see Chapter 14 by Wallace et al. ; Calvert et al. 2004 ; Stein and Meredith 1993 ), but little of this research has had a developmental focus (but see Brainard and Knudsen 1993 ; King…”