Matterport3D: Learning from RGB-D Data in Indoor Environments

By Angel X. Chang, Angela Dai, Thomas A. Funkhouser, Maciej Halber, Matthias Nießner, Manolis Savva, Shuran Song, Andy Zeng, Yinda Zhang. 2017

2,583 citations recorded by the source corpus.

Access to large, diverse RGB-D datasets is critical for training RGB-D scene understanding algorithms. However, existing datasets still cover only a limited number of views or a restricted scale of spaces. In this paper, we introduce Matterport3D, a large-scale RGB-D dataset containing 10,800 panoramic views from 194,400 RGB-D images of 90 building-scale scenes. Annotations are provided with surface reconstructions, camera poses, and 2D and 3D semantic segmentations. The precise global alignment and comprehensive, diverse panoramic set of views over entire buildings enable a variety of supervised and self-supervised computer vision tasks, including keypoint matching, view overlap prediction, normal prediction from color, semantic segmentation, and region classification.

Subfields: Computer Vision and Pattern Recognition, Environmental Engineering, Geology, Representation & Self-Supervised Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Jitendra Malik
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Ming-Hsuan Yang
  7. Andrew Zisserman
  8. Cordelia Schmid

In Environmental Engineering

  1. Matthias Nießner
  2. Jitendra Malik
  3. Angela Dai
  4. Silvio Savarese
  5. Saurabh Gupta
  6. Thomas A. Funkhouser
  7. Dhruv Batra
  8. Kristen Grauman

In Geology

  1. Matthias Nießner
  2. Jitendra Malik
  3. Angela Dai
  4. Andreas Geiger
  5. Leonidas J. Guibas
  6. Or Litany
  7. Silvio Savarese
  8. Charles Ruizhongtai Qi

In Representation & Self-Supervised Learning

  1. Trevor Darrell
  2. Andrea Vedaldi
  3. Andrew Zisserman
  4. Kristen Grauman
  5. Antonio Torralba
  6. Abhinav Kumar Gupta
  7. Jitendra Malik
  8. Dacheng Tao

Citations in the corpus