Continuous control with deep reinforcement learning

By Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Manfred Otto Heess, Tom Erez, Yuval Tassa, David Silver, Daan Wierstra. International Conference on Learning Representations, 2015

15,687 citations recorded by the source corpus.

We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain. We present an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. Using the same learning algorithm, network architecture and hyper-parameters, our algorithm robustly solves more than 20 simulated physics tasks, including classic problems such as cartpole swing-up, dexterous manipulation, legged locomotion and car driving. Our algorithm is able to find policies whose performance is competitive with those found by a planning algorithm with full access to the dynamics of the domain and its derivatives. We further demonstrate that for many of the tasks the algorithm can learn policies end-to-end: directly from raw pixel inputs.

Subfields: Artificial Intelligence, Computational Theory and Mathematics, Control and Systems Engineering, Reinforcement Learning

View Paper: https://arxiv.org/abs/1509.02971

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Pieter Abbeel
  3. Yoshua Bengio
  4. Mohit Bansal
  5. Chelsea Finn
  6. Ruslan Salakhutdinov
  7. Quoc V. Le
  8. Jianfeng Gao

In Computational Theory and Mathematics

  1. Sergey Levine
  2. Pieter Abbeel
  3. Ofir Nachum
  4. Shimon Whiteson
  5. Chelsea Finn
  6. Shixiang Shane Gu
  7. Nicolas Manfred Otto Heess
  8. Jan Peters

In Control and Systems Engineering

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Abhishek Gupta
  5. Jan Peters
  6. Vikash Kumar
  7. Shixiang Shane Gu
  8. Abhinav Kumar Gupta

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Shimon Whiteson
  5. Ofir Nachum
  6. Shixiang Shane Gu
  7. Yuxi Li
  8. Abhishek Gupta

Citations in the corpus