Attention mechanism-based CNN for facial expression recognition
By Jing Li, Kan Jin, Dalin Zhou, Naoyuki Kubota, Zhaojie Ju. Neurocomputing, 2020
312 citations recorded by the source corpus.
Abstract Facial expression recognition is a hot research topic and can be applied in many computer vision fields, such as human–computer interaction, affective computing and so on. In this paper, we propose a novel end-to-end network with attention mechanism for automatic facial expression recognition. The new network architecture consists of four parts, i.e., the feature extraction module, the attention module, the reconstruction module and the classification module. The LBP features extract image texture information and then catch the small movements of the faces, which can improve the network performance. Attention mechanism can make the neural network pay more attention to useful features. We combine LBP features and attention mechanism to enhance the attention model to obtain better results. In addition, we collected and labelled a new facial expression dataset of seven expressions from 35 subjects aged from 20 to 25. For each subject, we captured both RGB images and depth images with a Microsoft Kinect sensor. For each image type, there are 245 image sequences, each of which contains 110 images, resulting in 26,950 images in total. We apply the newly proposed method to our own dataset and four representative expression datasets, i.e., JAFFE, CK+, FER2013 and Oulu-CASIA. The experimental results demonstrate the feasibility and effectiveness of the proposed method.
Subfields: Computer Vision and Pattern Recognition, Experimental and Cognitive Psychology
View Paper: https://www.semanticscholar.org/paper/bb3cea32296530073c0bc5a92bf8760f29db74da
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Computer Vision and Pattern Recognition
- Victoria Blanes-Vidal
- Esmaeil S. Nadimi
- Zhengyao Wen
- Ge Xu
- U. Rajendra Acharya
- Smith K. Khare
- Wen-Long Lin
- Tao Wang
In Experimental and Cognitive Psychology
Citations in the corpus
- Emotion recognition and artificial intelligence: A systematic review (2014-2023) and research recommendations (2023, methodology): “Attention-modules with CNN have also been proven effective to detect face geometry for emotion recognition [129,133–136].”
- Distract Your Attention: Multi-Head Cross Attention Network for Facial Expression Recognition (2021, background): “To attend to local details, some recent studies focus on attention mechanisms [9, 10, 11], achieving promising results.”