A review of Convolutional-Neural-Network-based action recognition

By Guangle Yao, Tao Lei, Jiandan Zhong. Pattern Recognition Letters, 2019

391 citations recorded by the source corpus.

Abstract Video action recognition is widely applied in video indexing, intelligent surveillance, multimedia understanding, and other fields. Recently, it was greatly improved by incorporating the learning of deep information using Convolutional Neural Network (CNN). This motivated us to review the notable CNN-based action recognition works. Because CNN is primarily designed to extract 2D spatial features from still image and videos are naturally viewed as 3D spatiotemporal signals, the core issue of extending the CNN from image to video is temporal information exploitation. We divide the solutions for exploiting temporal information exploration into three strategies: 1) 3D CNN; 2) taking the motion-related information as the CNN input; and 3) fusion. In this paper, we present a comprehensive review of the CNN-based action recognition methods according to these strategies. We also discuss the action recognition performance on recent large-scale benchmarks and the limitations and future research directions of CNN-based action recognition. This paper offers an objective and clear review of CNN-based action recognition and provides a guide for future research.

Subfields: Artificial Intelligence, Biomedical Engineering, Computer Vision and Pattern Recognition

View Paper: https://www.semanticscholar.org/paper/2c12495bfb2f47881191ce0cb672f0372c6a31e2

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. D. Bull
  2. Nantheera Anantrasirichai

In Biomedical Engineering

  1. D. Bull
  2. Nantheera Anantrasirichai

In Computer Vision and Pattern Recognition

  1. D. Bull
  2. Nantheera Anantrasirichai

Citations in the corpus