Deep Reinforcement Learning framework for Autonomous Driving

By Ahmad El Sallab, Mohammed Abdou, Etienne Perot, Senthil Kumar Yogamani. 2017

1,062 citations recorded by the source corpus.

Reinforcement learning is considered to be a strong AI paradigm which can be used to teach machines through interaction with the environment and learning from their mistakes. Despite its perceived utility, it has not yet been successfully applied in automotive applications. Motivated by the successful demonstrations of learning of Atari games and Go by Google DeepMind, we propose a framework for autonomous driving using deep reinforcement learning. This is of particular relevance as it is difficult to pose autonomous driving as a supervised learning problem due to strong interactions with the environment including other vehicles, pedestrians and roadworks. As it is a relatively new area of research for autonomous driving, we provide a short overview of deep reinforcement learning and then describe our proposed framework. It incorporates Recurrent Neural Networks for information integration, enabling the car to handle partially observable scenarios. It also integrates the recent work on attention models to focus on relevant information, thereby reducing the computational complexity for deployment on embedded hardware. The framework was tested in an open source 3D car racing simulator called TORCS. Our simulation results demonstrate learning of autonomous maneuvering in a scenario of complex road curvatures and simple interaction of other vehicles.

Subfields: Artificial Intelligence, Automotive Engineering, Reinforcement Learning, Robotics & Control

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Ruslan Salakhutdinov
  4. Pieter Abbeel
  5. Dacheng Tao
  6. Mohit Bansal
  7. Percy Liang
  8. Quoc V. Le

In Automotive Engineering

  1. Sergey Levine
  2. Aviral Kumar
  3. Jacob Lambert
  4. Alexander Carballo
  5. Ekim Yurtsever
  6. Aravind Rajeswaran
  7. Sergey I. Nikolenko
  8. George Tucker

In Reinforcement Learning

  1. Sergey Levine
  2. Aravind Rajeswaran
  3. Pieter Abbeel
  4. Aviral Kumar
  5. Chelsea Finn
  6. Ofir Nachum
  7. George Tucker
  8. Shixiang Shane Gu

In Robotics & Control

  1. Sergey Levine
  2. Aravind Rajeswaran
  3. George Tucker
  4. Justin Fu
  5. Sergey I. Nikolenko
  6. Pieter Abbeel
  7. Aviral Kumar
  8. Chelsea Finn

Citations in the corpus