Recurrent World Models Facilitate Policy Evolution

By David R Ha, J. Urgen Schmidhuber. 2018

1,336 citations recorded by the source corpus.

A generative recurrent neural network is quickly trained in an unsupervised manner to model popular reinforcement learning environments through compressed spatio-temporal representations. The world model's extracted features are fed into compact and simple policies trained by evolution, achieving state of the art results in various environments. We also train our agent entirely inside of an environment generated by its own internal world model, and transfer this policy back into the actual environment. Interactive version of this paper is available at https://worldmodels.github.io

Subfields: Development, Reinforcement Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Development

  1. Jimmy Ba
  2. Amir-massoud Farahmand
  3. David R Ha
  4. Adam Gaier
  5. Tingwu Wang
  6. Sergey Levine
  7. Denis Yarats
  8. Brandon Amos

In Reinforcement Learning

  1. Sergey Levine
  2. Pieter Abbeel
  3. Chelsea Finn
  4. Ofir Nachum
  5. Shixiang Shane Gu
  6. Jimmy Ba
  7. Timothy P. Lillicrap
  8. Yuxi Li

Citations in the corpus