Generative Adversarial Imitation Learning

By Jonathan Ho, Stefano Ermon. 2016

3,722 citations recorded by the source corpus.

Consider learning a policy from example expert behavior, without interaction with the expert or access to reinforcement signal. One approach is to recover the expert's cost function with inverse reinforcement learning, then extract a policy from that cost function with reinforcement learning. This approach is indirect and can be slow. We propose a new general framework for directly extracting a policy from data, as if it were obtained by reinforcement learning following inverse reinforcement learning. We show that a certain instantiation of our framework draws an analogy between imitation learning and generative adversarial networks, from which we derive a model-free imitation learning algorithm that obtains significant performance gains over existing model-free methods in imitating complex behaviors in large, high-dimensional environments.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Statistical and Nonlinear Physics, Reinforcement Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Pieter Abbeel
  3. Yoshua Bengio
  4. Mohit Bansal
  5. Chelsea Finn
  6. Ruslan Salakhutdinov
  7. Quoc V. Le
  8. Jianfeng Gao

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Jitendra Malik
  5. Xiaogang Wang
  6. Ming-Hsuan Yang
  7. Andrew Zisserman
  8. Andrea Vedaldi

In Statistical and Nonlinear Physics

  1. Sergey Levine
  2. Stefano Ermon
  3. Pieter Abbeel
  4. Yang Song
  5. Chelsea Finn
  6. Yoshua Bengio
  7. Jiaming Song
  8. Arash Vahdat

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Ofir Nachum
  5. Shimon Whiteson
  6. Yuxi Li
  7. Shixiang Shane Gu
  8. Abhishek Gupta

Citations in the corpus