Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group

By Raviteja Vemulapalli, Felipe Arrate, Ramalingam Chellappa. 2014

1,475 citations recorded by the source corpus.

Recently introduced cost-effective depth sensors coupled with the real-time skeleton estimation algorithm of Shotton et al. [16] have generated a renewed interest in skeleton-based human action recognition. Most of the existing skeleton-based approaches use either the joint locations or the joint angles to represent a human skeleton. In this paper, we propose a new skeletal representation that explicitly models the 3D geometric relationships between various body parts using rotations and translations in 3D space. Since 3D rigid body motions are members of the special Euclidean group SE(3), the proposed skeletal representation lies in the Lie group SE(3)×.. .×SE(3), which is a curved manifold. Using the proposed representation, human actions can be modeled as curves in this Lie group. Since classification of curves in this Lie group is not an easy task, we map the action curves from the Lie group to its Lie algebra, which is a vector space. We then perform classification using a combination of dynamic time warping, Fourier temporal pyramid representation and linear SVM. Experimental results on three action datasets show that the proposed representation performs better than many existing skeletal representations. The proposed approach also outperforms various state-of-the-art skeleton-based human action recognition approaches.

Subfields: Biomedical Engineering, Computer Vision and Pattern Recognition, 3D Vision & Pose, Human-Computer Interaction

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Biomedical Engineering

  1. Jun Liu
  2. Hossein Rahmani
  3. G. Wang
  4. Wanqing Li
  5. Liang Wang
  6. Pichao Wang
  7. Qiuhong Ke
  8. Hanqing Lu

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. G. Wang
  3. Dacheng Tao
  4. Xiaogang Wang
  5. Jun Liu
  6. Ming-Hsuan Yang
  7. Yi Yang
  8. Trevor Darrell

In 3D Vision & Pose

  1. Jun Liu
  2. G. Wang
  3. Amir Shahroudy
  4. Hossein Rahmani
  5. Tae-Kyun Kim
  6. Alex ChiChung Kot
  7. Ling-yu Duan
  8. Mohammed Bennamoun

In Human-Computer Interaction

  1. Jun Liu
  2. Wanqing Li
  3. Hossein Rahmani
  4. Pichao Wang
  5. G. Wang
  6. Amir Shahroudy
  7. Hanqing Lu
  8. Mengyuan Liu

Citations in the corpus