PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

By Yu Xiang, Tanner Schmidt, Venkatraman Narayanan, Dieter Fox. 2017

2,347 citations recorded by the source corpus.

Estimating the 6D pose of known objects is important for robots to interact with the real world. The problem is challenging due to the variety of objects as well as the complexity of a scene caused by clutter and occlusions between objects. In this work, we introduce PoseCNN, a new Convolutional Neural Network for 6D object pose estimation. PoseCNN estimates the 3D translation of an object by localizing its center in the image and predicting its distance from the camera. The 3D rotation of the object is estimated by regressing to a quaternion representation. We also introduce a novel loss function that enables PoseCNN to handle symmetric objects. In addition, we contribute a large scale video dataset for 6D object pose estimation named the YCB-Video dataset. Our dataset provides accurate 6D poses of 21 objects from the YCB dataset observed in 92 videos with 133,827 frames. We conduct extensive experiments on our YCB-Video dataset and the OccludedLINEMOD dataset to show that PoseCNN is highly robust to occlusions, can handle symmetric objects, and provide accurate pose estimation using only color images as input. When using depth data to further refine the poses, our approach achieves state-of-the-art results on the challenging OccludedLINEMOD dataset. Our code and dataset are available at this https URL.

Subfields: Computer Vision and Pattern Recognition, Control and Systems Engineering, 3D Vision & Pose, Human-Computer Interaction, Robotics & Control

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Jitendra Malik
  3. Dacheng Tao
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Ming-Hsuan Yang
  7. Cordelia Schmid
  8. Andrew Zisserman

In Control and Systems Engineering

  1. Sergey Levine
  2. Dieter Fox
  3. Chelsea Finn
  4. Pieter Abbeel
  5. Silvio Savarese
  6. Li Fei-Fei
  7. Jitendra Malik
  8. Yuke Zhu

In 3D Vision & Pose

  1. Jitendra Malik
  2. Abhinav Kumar Gupta
  3. Silvio Savarese
  4. Shubham Tulsiani
  5. Leonidas J. Guibas
  6. Angjoo Kanazawa
  7. David F. Fouhey
  8. Andreas Geiger

In Human-Computer Interaction

  1. Cordelia Schmid
  2. Jitendra Malik
  3. Bugra Tekin
  4. Pascal Fua
  5. Francesc Moreno-Noguer
  6. Angjoo Kanazawa
  7. Dieter Fox
  8. Xiaowei Zhou

In Robotics & Control

  1. Sergey Levine
  2. Chelsea Finn
  3. Dieter Fox
  4. Silvio Savarese
  5. Abhinav Kumar Gupta
  6. Li Fei-Fei
  7. Pieter Abbeel
  8. Yuke Zhu

Citations in the corpus