Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications

By Minglu Zhu, Zhongda Sun, Zixuan Zhang, Qiongfeng Shi, Tianyiyi He, Huicong Liu, Tao Chen, Chengkuo Lee. Science Advances, 2020

678 citations recorded by the source corpus.

A haptic-feedback glove with triboelectric sensors and piezoelectric stimulators is developed for interaction in virtual space. Human-machine interfaces (HMIs) experience increasing requirements for intuitive and effective manipulation. Current commercialized solutions of glove-based HMI are limited by either detectable motions or the huge cost on fabrication, energy, and computing power. We propose the haptic-feedback smart glove with triboelectric-based finger bending sensors, palm sliding sensor, and piezoelectric mechanical stimulators. The detection of multidirectional bending and sliding events is demonstrated in virtual space using the self-generated triboelectric signals for various degrees of freedom on human hand. We also perform haptic mechanical stimulation via piezoelectric chips to realize the augmented HMI. The smart glove achieves object recognition using machine learning technique, with an accuracy of 96%. Through the integrated demonstration of multidimensional manipulation, haptic feedback, and AI-based object recognition, our glove reveals its potential as a promising solution for low-cost and advanced human-machine interaction, which can benefit diversified areas, including entertainment, home healthcare, sports training, and medical industry.

Subfields: Biomedical Engineering, Cognitive Neuroscience, Human-Computer Interaction

View Paper: https://www.semanticscholar.org/paper/719eabcd265a3280e3ec36f38b45fb5668d77403

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Biomedical Engineering

1. Chengkuo Lee
2. Xinge Guo
3. Long Liu
4. Tianyiyi He
5. Feng Wen
6. Zixuan Zhang
7. Qiongfeng Shi
8. Bowei Dong

In Cognitive Neuroscience

1. Chengkuo Lee
2. Xinge Guo
3. Long Liu
4. Tianyiyi He
5. Feng Wen
6. Zixuan Zhang
7. Qiongfeng Shi
8. Jianxiong Zhu

In Human-Computer Interaction

1. Xinge Guo
2. Long Liu
3. Chengkuo Lee
4. Carlos Bermejo
5. Pan Hui

Citations in the corpus

• Progress in TENG technology—A journey from energy harvesting to nanoenergy and nanosystem (2020, methodology): “of things (IoT) and the fifth-generation wireless networks (5G), various self-powered electronics are considered as the building blocks for the foundation of the coming industrial revolution toward a smart world.(22-25) This wide distribution of self-powered electronics cover spheres of application ”
• Promoting smart cities into the 5G era with multi-field Internet of Things (IoT) applications powered with advanced mechanical energy harvesters (2021, background): “(k) Haptic-feedback smart glove for virtual/augmented reality applications [367].”
• All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda (2021, background): “call for additional research attention in this area for building seamless yet realistic user interaction [170] with various entities linked to the metaverse, as illustrated in Figure 9.”
• AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove (2021, methodology): “The integration of AI with the TENG glove may shed light on more diversi fi ed and complex gesture monitoring that is rarely achievable using the conventional manual feature extraction 52 .”