Prioritized Experience Replay

By Tom Schaul, John Quan, Ioannis Antonoglou, David Silver. 2015

4,495 citations recorded by the source corpus.

Experience replay lets online reinforcement learning agents remember and reuse experiences from the past. In prior work, experience transitions were uniformly sampled from a replay memory. However, this approach simply replays transitions at the same frequency that they were originally experienced, regardless of their significance. In this paper we develop a framework for prioritizing experience, so as to replay important transitions more frequently, and therefore learn more efficiently. We use prioritized experience replay in Deep Q-Networks (DQN), a reinforcement learning algorithm that achieved human-level performance across many Atari games. DQN with prioritized experience replay achieves a new state-of-the-art, outperforming DQN with uniform replay on 41 out of 49 games.

Subfields: Artificial Intelligence, Cognitive Neuroscience, Electrical and Electronic Engineering, Reinforcement Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Pieter Abbeel
  4. Mohit Bansal
  5. Ruslan Salakhutdinov
  6. Quoc V. Le
  7. Jianfeng Gao
  8. Chelsea Finn

In Cognitive Neuroscience

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Yoshua Bengio
  5. Jeff Clune
  6. Marc G. Bellemare
  7. Timothy P. Lillicrap
  8. Matthew Botvinick

In Electrical and Electronic Engineering

  1. Sergey Levine
  2. Ofir Nachum
  3. Shimon Whiteson
  4. Pieter Abbeel
  5. Yuxi Li
  6. Shixiang Shane Gu
  7. Mohammad Norouzi
  8. Aviral Kumar

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Ofir Nachum
  5. Shimon Whiteson
  6. Yuxi Li
  7. Shixiang Shane Gu
  8. Marc G. Bellemare

Citations in the corpus