Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models

By Gabriel Lima Guimaraes, Benjamín Sánchez-Lengeling, Pedro Luis Cunha Farias, Alán Aspuru-Guzik. 2017

580 citations recorded by the source corpus.

In unsupervised data generation tasks, besides the generation of a sample based on previous observations, one would often like to give hints to the model in order to bias the generation towards desirable metrics. We propose a method that combines Generative Adversarial Networks (GANs) and reinforcement learning (RL) in order to accomplish exactly that. While RL biases the data generation process towards arbitrary metrics, the GAN component of the reward function ensures that the model still remembers information learned from data. We build upon previous results that incorporated GANs and RL in order to generate sequence data and test this model in several settings for the generation of molecules encoded as text sequences (SMILES) and in the context of music generation, showing for each case that we can effectively bias the generation process towards desired metrics.

Subfields: Artificial Intelligence, Materials Chemistry, Reinforcement Learning, Generative Models, Natural Language Generation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Mohit Bansal
  3. Percy Liang
  4. Jianfeng Gao
  5. Jure Leskovec
  6. Quoc V. Le
  7. Caiming Xiong
  8. Dacheng Tao

In Materials Chemistry

  1. Tommi S. Jaakkola
  2. Regina Barzilay
  3. Jure Leskovec
  4. Wengong Jin
  5. José Miguel Hernández-Lobato
  6. Ola Engkvist
  7. Rex Ying
  8. Jiaxuan You

In Reinforcement Learning

  1. José Miguel Hernández-Lobato
  2. Jure Leskovec
  3. Rex Ying
  4. Jiaxuan You
  5. Tommi S. Jaakkola
  6. Regina Barzilay
  7. Wengong Jin
  8. Caiming Xiong

In Generative Models

  1. Tommi S. Jaakkola
  2. Regina Barzilay
  3. Wengong Jin
  4. Jure Leskovec
  5. William L. Hamilton
  6. Rex Ying
  7. Alán Aspuru-Guzik
  8. Jiaxuan You

In Natural Language Generation

  1. José Miguel Hernández-Lobato
  2. Yongjun Hong
  3. Uiwon Hwang
  4. Sungroh Yoon
  5. Thomas Kipf
  6. Nicola De Cao
  7. Jaeyoon Yoo
  8. Alán Aspuru-Guzik

Citations in the corpus