Reality-based interaction: a framework for post-WIMP interfaces

By Robert J. K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, E. Solovey, Jamie Zigelbaum. International Conference on Human Factors in Computing Systems, 2008

931 citations recorded by the source corpus.

Subfields: Computer Vision and Pattern Recognition, Human-Computer Interaction

View Paper: https://www.semanticscholar.org/paper/a2001bd39df0eac404a0391e0dd5df6fc77f719d

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

In Human-Computer Interaction

Citations in the corpus

Survey on human–robot collaboration in industrial settings: Safety, intuitive interfaces and applications (2018, background): “NUIs offer a natural and reality-based interaction by exploiting users’ pre-existing knowledge and using actions that correspond to daily practices in the physical world [93].”
Fluid interaction for information visualization (2011, methodology): “This insight has led the field of HCI to a new generation of user interfaces based on reality-based interaction.(37) These interfaces use modalities such as body tracking, bi-manual multi-touch interaction, or tangible objects to further reduce the users’ gulf of execution and to draw strength by em”
Designing sports: a framework for exertion games (2011, background): “to explain bodily interaction with non-keyboard controlled devices [18, 19].”
Virtual reality and augmented reality in social learning spaces: a literature review (2020, background): “This is perhaps where existing research into Reality-Based Interactions using full-body and gestural inputs can be useful (Jacob et al. 2008; Snibbe and Raffle 2009) as it allows another perspective into how we can have multiple learners interacting together in a genuinely collaborative manner…”
A survey of 3D object selection techniques for virtual environments (2013, neutral): “3DUIs are based upon real-world characteristics such 730 as naive physics, body awareness, environmental awareness, so731 cial awareness and social skills [45].”
Fashion retailing – past, present and future (2014, background): “Interactivity controlled by users allows for a synaesthetic response between the subject and the media [359].”
Transitioning to Human Interaction with AI Systems: New Challenges and Opportunities for HCI Professionals to Enable Human-Centered AI (2021, background): “…and Non-WIMP, such as the PIBG paradigm (physical object, icon, button, gesture) for pen interaction (Dai & Wang, 2004), and RBI (reality-based interaction) for virtual reality (Jacob et al., 2008), but the effectiveness of these proposed paradigms requires verification (Fan et al., 2018).”