AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles

By Shital Shah, Debadeepta Dey, Chris Lovett, Ashish Kapoor. 2017

2,474 citations recorded by the source corpus.

Developing and testing algorithms for autonomous vehicles in real world is an expensive and time consuming process. Also, in order to utilize recent advances in machine intelligence and deep learning we need to collect a large amount of annotated training data in a variety of conditions and environments. We present a new simulator built on Unreal Engine that offers physically and visually realistic simulations for both of these goals. Our simulator includes a physics engine that can operate at a high frequency for real-time hardware-in-the-loop (HITL) simulations with support for popular protocols (e.g. MavLink). The simulator is designed from the ground up to be extensible to accommodate new types of vehicles, hardware platforms and software protocols. In addition, the modular design enables various components to be easily usable independently in other projects. We demonstrate the simulator by first implementing a quadrotor as an autonomous vehicle and then experimentally comparing the software components with real-world flights.

Subfields: Automotive Engineering, Control and Systems Engineering, Management Science and Operations Research, ML Systems & Hardware, Robotics & Control

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Automotive Engineering

  1. Sergey I. Nikolenko
  2. Davide Scaramuzza
  3. Vladlen Koltun
  4. Dengxin Dai
  5. Luc Van Gool
  6. Matthias Müller
  7. Longlong Jing
  8. Yingli Tian

In Control and Systems Engineering

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Abhinav Kumar Gupta
  5. Lerrel Pinto
  6. Vladlen Koltun
  7. Ajay Mandlekar
  8. Ruslan Salakhutdinov

In Management Science and Operations Research

  1. Pieter Abbeel
  2. Ruslan Salakhutdinov
  3. Sergey I. Nikolenko
  4. Vladlen Koltun
  5. Sergey Levine
  6. Josh Tenenbaum
  7. Abhinav Kumar Gupta
  8. Jiarong Lin

In ML Systems & Hardware

  1. Sergey I. Nikolenko
  2. Josh Tenenbaum
  3. Yingli Tian
  4. Jiarong Lin
  5. Longlong Jing
  6. Fu Zhang
  7. Chen Wang
  8. Yuheng Qiu

In Robotics & Control

  1. Sergey Levine
  2. Vladlen Koltun
  3. Sergey I. Nikolenko
  4. Abhinav Kumar Gupta
  5. Roozbeh Mottaghi
  6. Pieter Abbeel
  7. Lerrel Pinto
  8. Alexey Dosovitskiy

Citations in the corpus