Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition

By Guozhen Li, Shiqiang Liu, Liangqi Wang, Ronglin Zhu. Science Robotics, 2020

408 citations recorded by the source corpus.

A robot hand integrated with quadruple tactile sensors can recognize a diverse set of objects for garbage sorting. Robot hands with tactile perception can improve the safety of object manipulation and also improve the accuracy of object identification. Here, we report the integration of quadruple tactile sensors onto a robot hand to enable precise object recognition through grasping. Our quadruple tactile sensor consists of a skin-inspired multilayer microstructure. It works as thermoreceptor with the ability to perceive thermal conductivity of a material, measure contact pressure, as well as sense object temperature and environment temperature simultaneously and independently. By combining tactile sensing information and machine learning, our smart hand has the capability to precisely recognize different shapes, sizes, and materials in a diverse set of objects. We further apply our smart hand to the task of garbage sorting and demonstrate a classification accuracy of 94% in recognizing seven types of garbage.

Subfields: Biomedical Engineering, Cellular and Molecular Neuroscience, Cognitive Neuroscience

View Paper: https://www.semanticscholar.org/paper/d6af3bf1dc1cb2b7a6388ac0b310421b086d4543

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Biomedical Engineering

1. Qijun Sun
2. Xiaole Cao
3. Yao Xiong
4. Jia Sun
5. Zhongqiang Wang
6. Xiaoyin Xie

Citations in the corpus

• Artificial Intelligence Meets Flexible Sensors: Emerging Smart Flexible Sensing Systems Driven by Machine Learning and Artificial Synapses (2023, background): “Zhu’s group reported a robotic hand with an integrated quadruple tactile sensor that can simultaneously and independently perceive multiple stimuli such as contact pressure, material thermal conductivity, object, and ambient temperature to accurately recognize various objects [203].”
• Multidiscipline Applications of Triboelectric Nanogenerators for the Intelligent Era of Internet of Things (2022, background): “These subtle features hidden behind the real-time signal spectrum could be automatically extracted for AI applications, e.g., gesture recognition [28], texture recognition [29], object classification [30, 31], VR [32], and digital twins [33].”