When do we interact multimodally?: cognitive load and multimodal communication patterns

By Sharon L. Oviatt, Rachel Coulston, R. Lunsford. International Conference on Multimodal Interaction, 2004

313 citations recorded by the source corpus.

Subfields: Artificial Intelligence, Information Systems and Management, Human-Computer Interaction

View Paper: https://www.semanticscholar.org/paper/c085a1edac18ebe2de06419f45d9fb70bf196659

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Information Systems and Management

In Human-Computer Interaction

Citations in the corpus

Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2012, background): “Indeed, users preferred multimodal to unimodal interaction when complexity of a task was increased, which indicates that users self-manage resources of the working memory by shifting from unimodal to multimodal interaction with increasing cognitive demands (Oviatt, Coulston, & Lunsford, 2004).”
Interaction in 4-second bursts: the fragmented nature of attentional resources in mobile HCI (2005, background): “In general, such systems have the potential of providing much better support for users’ context-driven allocation of attention [24].”
Galvanic skin response (GSR) as an index of cognitive load (2007, methodology): “Multimodal interfaces are known to reduce the level of experienced cognitive load over unimodal interfaces [6].”
A Review of Intent Detection, Arbitration, and Communication Aspects of Shared Control for Physical Human-Robot Interaction (2018, background): “Leveraging a multimodal feedback strategy for complex tasks is also preferred by users over unimodal interactions [97] and well suited for complex tasks with high workload in one modality, so as to prevent cognitive overload and in turn enhance motor learning [98].”
Human-centered design meets cognitive load theory: designing interfaces that help people think (2006, background): “Apart from error handling, users respond to dynamic changes in their own working memory limitations and cognitive load by shifting to more multimodal communication as load increases with task difficulty [28] .”
Multimodal interaction: A review (2014, background): “…systems Table 2 A classification of multimodal interfaces types, after Nigay and Coutaz (1993). can indicate about a user's cognitive load (Chen et al. 2012), when people naturally interact multimodally (Oviatt et al. 2004), and how alternative modalities may reduce or increase the cognitive load.”