ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM

By Carlos Campos, Richard Elvira, Juan J. Gómez Rodríguez, José M. M. Montiel, Juan D. Tardós. IEEE Transactions on robotics, 2020

4,364 citations recorded by the source corpus.

This article presents ORB-SLAM3, the first system able to perform visual, visual-inertial and multimap SLAM with monocular, stereo and RGB-D cameras, using pin-hole and fisheye lens models. The first main novelty is a tightly integrated visual-inertial SLAM system that fully relies on maximum a posteriori (MAP) estimation, even during IMU initialization, resulting in real-time robust operation in small and large, indoor and outdoor environments, being two to ten times more accurate than previous approaches. The second main novelty is a multiple map system relying on a new place recognition method with improved recall that lets ORB-SLAM3 survive to long periods of poor visual information: when it gets lost, it starts a new map that will be seamlessly merged with previous maps when revisiting them. Compared with visual odometry systems that only use information from the last few seconds, ORB-SLAM3 is the first system able to reuse in all the algorithm stages all previous information from high parallax co-visible keyframes, even if they are widely separated in time or come from previous mapping sessions, boosting accuracy. Our experiments show that, in all sensor configurations, ORB-SLAM3 is as robust as the best systems available in the literature and significantly more accurate. Notably, our stereo-inertial SLAM achieves an average accuracy of 3.5 cm in the EuRoC drone and 9 mm under quick hand-held motions in the room of TUM-VI dataset, representative of AR/VR scenarios. For the benefit of the community we make public the source code.

Subfields: Aerospace Engineering, Computer Vision and Pattern Recognition, Geology

View Paper: https://www.semanticscholar.org/paper/77d7e439b3368875199a1327515a3ba212f0a359

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Aerospace Engineering

  1. Luca Carlone
  2. Antoni Rosinol
  3. Yohann Cabon
  4. Vincent Leroy
  5. Jérôme Revaud
  6. Yun Chang
  7. Zachary Teed
  8. Jia Deng

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Andrea Vedaldi
  3. Dacheng Tao
  4. Jitendra Malik
  5. Xiaogang Wang
  6. Cordelia Schmid
  7. Andrew Zisserman
  8. Trevor Darrell

In Geology

  1. Yun Chang
  2. Marcus Abate
  3. Xiaowei Zhou
  4. Jia Deng
  5. Hujun Bao
  6. Gwenolé Corre
  7. Luca Carlone
  8. Deva Ramanan

Citations in the corpus