End-to-End Driving Via Conditional Imitation Learning

By Felipe Codevilla, Matthias Müller, Alexey Dosovitskiy, Antonio M. López, Vladlen Koltun. 2017

1,304 citations recorded by the source corpus.

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate an expert cannot be guided to take a specific turn at an upcoming intersection. This limits the utility of such systems. We propose to condition imitation learning on high-level command input. At test time, the learned driving policy functions as a chauffeur that handles sensorimotor coordination but continues to respond to navigational commands. We evaluate different architectures for conditional imitation learning in vision-based driving. We conduct experiments in realistic three-dimensional simulations of urban driving and on a 1/5 scale robotic truck that is trained to drive in a residential area. Both systems drive based on visual input yet remain responsive to high-level navigational commands.

Subfields: Artificial Intelligence, Automotive Engineering, Control and Systems Engineering, Reinforcement Learning, Robotics & Control

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Yoshua Bengio
  5. Mohit Bansal
  6. Trevor Darrell
  7. Ruslan Salakhutdinov
  8. Dacheng Tao

In Automotive Engineering

  1. Andreas Geiger
  2. Sergey Levine
  3. Kashyap Chitta
  4. Pravendra Singh
  5. Pranav Singh Chib
  6. Raquel Urtasun
  7. Hongyang Li
  8. Li Chen

In Control and Systems Engineering

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Silvio Savarese
  5. Li Fei-Fei
  6. Abhishek Gupta
  7. Dieter Fox
  8. Vladlen Koltun

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Aviral Kumar
  5. Abhishek Gupta
  6. Benjamin Eysenbach
  7. Shixiang Shane Gu
  8. Justin Fu

In Robotics & Control

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Silvio Savarese
  5. Vladlen Koltun
  6. Li Fei-Fei
  7. Dieter Fox
  8. Andreas Geiger

Citations in the corpus