Convolutional Pose Machines

By Shih-En Wei, Varun Ramakrishna, Takeo Kanade, Yaser Sheikh. 2016

2,922 citations recorded by the source corpus.

Pose Machines provide a sequential prediction framework for learning rich implicit spatial models. In this work we show a systematic design for how convolutional networks can be incorporated into the pose machine framework for learning image features and image-dependent spatial models for the task of pose estimation. The contribution of this paper is to implicitly model long-range dependencies between variables in structured prediction tasks such as articulated pose estimation. We achieve this by designing a sequential architecture composed of convolutional networks that directly operate on belief maps from previous stages, producing increasingly refined estimates for part locations, without the need for explicit graphical model-style inference. Our approach addresses the characteristic difficulty of vanishing gradients during training by providing a natural learning objective function that enforces intermediate supervision, thereby replenishing back-propagated gradients and conditioning the learning procedure. We demonstrate state-of-the-art performance and outperform competing methods on standard benchmarks including the MPII, LSP, and FLIC datasets.

Subfields: Aerospace Engineering, Artificial Intelligence, Computer Vision and Pattern Recognition, 3D Vision & Pose

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Jitendra Malik
  2. Luc Van Gool
  3. Andreas Geiger
  4. Abhinav Kumar Gupta
  5. Xiaogang Wang
  6. Pascal Fua
  7. Andrea Vedaldi
  8. Cordelia Schmid

In Artificial Intelligence

  1. Trevor Darrell
  2. Luc Van Gool
  3. Bernt Schiele
  4. Dacheng Tao
  5. Yoshua Bengio
  6. Sergey Levine
  7. Quoc V. Le
  8. Mohit Bansal

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Jitendra Malik
  4. Xiaogang Wang
  5. Ming-Hsuan Yang
  6. Yi Yang
  7. Trevor Darrell
  8. Andrew Zisserman

In 3D Vision & Pose

  1. Michael J. Black
  2. Jitendra Malik
  3. Hanbyul Joo
  4. Angjoo Kanazawa
  5. Juergen Gall
  6. Christian Theobalt
  7. Kyoung Mu Lee
  8. Cordelia Schmid

Citations in the corpus