Instrumental interaction: an interaction model for designing post-WIMP user interfaces

By Michel Beaudouin-Lafon. International Conference on Human Factors in Computing Systems, 2000

694 citations recorded by the source corpus.

This article introduces a new interaction model called Instrumental Interaction that extends and generalizes the principles of direct manipulation. It covers existing interaction styles, including traditional WIMP interfaces, as well as new interaction styles such as two-handed input and augmented reality. It defines a design space for new interaction techniques and a set of properties for comparing them. Instrumental Interaction describes graphical user interfaces in terms of domain objects and interaction instruments. Interaction between users and domain objects is mediated by interaction instruments, similar to the tools and instruments we use in the real world to interact with physical objects. The article presents the model, applies it to describe and compare a number of interaction techniques, and shows how it was used to create a new interface for searching and replacing text.

Subfields: Computer Vision and Pattern Recognition, Human-Computer Interaction

View Paper: https://www.semanticscholar.org/paper/b5a4a11ff8a4fbc265e0f2cd2bee20193f42d3fd

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

In Human-Computer Interaction

Citations in the corpus

High precision touch screen interaction (2003, background): “Our exploration can be considered as designing “interaction instruments” [2] to overcome the limitations of bare hand direct manipulation.”
Getting a grip on tangible interaction: a framework on physical space and social interaction (2006, background): “Directness can also refer to the relation between the manipulation of interaction devices and the acted-upon objects as well as eventual effects [2].”
Designing interaction, not interfaces (2004, methodology): “(See [4] for details).”
Reality-based interaction: a framework for post-WIMP interfaces (2008, background): “Other work has focused on specific new interaction styles [6, 22, 37, 55].”
Embedded Data Representations (2017, methodology): “Here we refine the notion of distance by instead considering levels of indirection, a concept borrowed from Beaudouin-Lafon’s instrumental interaction framework [2].”
When second wave HCI meets third wave challenges (2006, background): “While these mediators all consist of physical as well as logical elements [4], it is not the border between the physical and the logical as such that is interesting, it is as much the action possibilities or affordances offered by a certain configuration for a certain purpose.”
Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-Operated Systems (2003, background): “In this paper, however , we will focus on the manipulation of icons. clipboard (Wagner, 1995; Beaudouin-Lafon, 2000).”
Exploring the use of tangible user interfaces for human-robot interaction: a comparative study (2008, background): “Beaudouin-Lafon [4] discusses measures for the mapping of physical controllers to their use in digital applications.”