Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays

By Mike Wu, Ravin Balakrishnan. ACM Symposium on User Interface Software and Technology, 2003

526 citations recorded by the source corpus.

Recent advances in sensing technology have enabled a new generation of tabletop displays that can sense multiple points of input from several users simultaneously. However, apart from a few demonstration techniques [17], current user interfaces do not take advantage of this increased input bandwidth. We present a variety of multifinger and whole hand gestural interaction techniques for these displays that leverage and extend the types of actions that people perform when interacting on real physical tabletops. Apart from gestural input techniques, we also explore interaction and visualization techniques for supporting shared spaces, awareness, and privacy. These techniques are demonstrated within a prototype room furniture layout application, called RoomPlanner.

Subfields: Cognitive Neuroscience, Human-Computer Interaction

View Paper: https://www.semanticscholar.org/paper/bbd13d2f92aeb08d73978e8958a12f793f175b8c

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Cognitive Neuroscience

In Human-Computer Interaction

Citations in the corpus

Direct-touch vs. mouse input for tabletop displays (2007, background): “INTRODUCTION Direct-touch interactive tabletop displays have been the focus of numerous research projects [11, 34, 36, 37, 38, 41] and appear to provide several benefits over traditional desktop displays.”
Fashion retailing – past, present and future (2014, background): “New multi-touch user interfaces support additional interaction techniques beyond pointing and tapping, and allow users to interact using single- and multi-finger gestures such as flicking, swiping, rotating and pinching [341, 342,343].”
Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques (2008, methodology): “3 Flick Slide Rule implements a flicking gesture similar to the gesture supported by the Apple iPhone and the flick gesture described by Wu and Balakrishnan [19].”
PlayAnywhere: a compact interactive tabletop projection-vision system (2005, background): “A second approach is to augment the presentation with onscreen widgets and modal interactions that channel the user into providing unambiguous input [37].”
TouchLight: an imaging touch screen and display for gesture-based interaction (2004, background): “Several research projects, however, are taking seriously the gesture-based manipulation of onscreen objects [15] [11] in the style of direct manipulation.”
User-defined gestures for surface computing (2009, methodology): “Wu and Balakrishnan [34] built RoomPlanner, a furniture layout application for the DiamondTouch [3], supporting gestures for rotation, menu access, object collection, and private viewing.”
Cooperative gestures: multi-user gestural interactions for co-located groupware (2006, background): “Several systems [7, 22, 24, 38, 40, 41] explore gesture interactions with tabletops, but none of these systems interpret the interactions of multiple users together as a single, cooperative gesture.”
Low-cost multi-touch sensing through frustrated total internal reflection (2005, methodology): “Initial investigations, though sparse due to the prohibitive availability of these devices, nonetheless reveal exciting potential for novel interaction techniques [1][2][11][12][19][23][26][27].”
Vision based hand gesture recognition for human computer interaction: a survey (2012, background): “Hand gestures are also used in computer supported collaborative work (CSCW) applications to enable multiple users to interact with a shared display, using a variety of computing devices such as desktop or tabletop displays (Wu and Balakrishnan 2003) or large screen displays (Cao and Balakrishnan 200”
Territoriality in collaborative tabletop workspaces (2004, background): “In the RoomPlanner [23] system, people can display private information on the table surface in front of them with a hand gesture that physically blocks the information from the view of others.”
It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre (2008, background): “Research has presented new kinds of collaborative touch-based interaction techniques that take into consideration multi-hand manipulations and touching possibilities (fingers, hand angles, user-user gestures etc.) [15,18, 26 ].1”
Precise selection techniques for multi-touch screens (2006, background): “However, with the recent emergence of many multi-touch prototype devices [1, 11, 14, 22, 25, 26], research on multi-finger and multi-hand touch interactions has increased [4, 7, 27].”