A Deep Structured Model with Radius–Margin Bound for 3D Human Activity Recognition

By Liang Lin, Keze Wang, Wangmeng Zuo, M. Wang, Jiebo Luo, Lei Zhang. 2015

106 citations recorded by the source corpus.

Understanding human activity is very challenging even with the recently developed 3D/depth sensors. To solve this problem, this work investigates a novel deep structured model, which adaptively decomposes an activity instance into temporal parts using the convolutional neural networks. Our model advances the traditional deep learning approaches in two aspects. First, we incorporate latent temporal structure into the deep model, accounting for large temporal variations of diverse human activities. In particular, we utilize the latent variables to decompose the input activity into a number of temporally segmented sub-activities, and accordingly feed them into the parts (i.e. sub-networks) of the deep architecture. Second, we incorporate a radius–margin bound as a regularization term into our deep model, which effectively improves the generalization performance for classification. For model training, we propose a principled learning algorithm that iteratively (i) discovers the optimal latent variables (i.e. the ways of activity decomposition) for all training instances, (ii) updates the classifiers based on the generated features, and (iii) updates the parameters of multi-layer neural networks. In the experiments, our approach is validated on several complex scenarios for human activity recognition and demonstrates superior performances over other state-of-the-art approaches.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Earnest Paul Ijjina
  2. C. Mohan
  3. Liliana Lo Presti
  4. Marco La Cascia
  5. Michael Edwards
  6. Xianghua Xie

In Computer Vision and Pattern Recognition

  1. Earnest Paul Ijjina
  2. C. Mohan
  3. Liliana Lo Presti
  4. Marco La Cascia
  5. Michael Edwards
  6. Xianghua Xie

Citations in the corpus