Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models

By Iulian Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C. Courville, Joelle Pineau. 2015

1,811 citations recorded by the source corpus.

We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up the possibility for realistic, flexible interactions. In support of this goal, we extend the recently proposed hierarchical recurrent encoder-decoder neural network to the dialogue domain, and demonstrate that this model is competitive with state-of-the-art neural language models and back-off n-gram models. We investigate the limitations of this and similar approaches, and show how its performance can be improved by bootstrapping the learning from a larger question-answer pair corpus and from pretrained word embeddings.

Subfields: Artificial Intelligence, Natural Language Processing, LLM Agents & Tool Use

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Mohit Bansal
  3. Jason Aaron Edward Weston
  4. Percy Liang
  5. Yoshua Bengio
  6. Luke S. Zettlemoyer
  7. Yejin Choi
  8. Kyunghyun Cho

In Natural Language Processing

  1. Jianfeng Gao
  2. Jason Aaron Edward Weston
  3. Mohit Bansal
  4. Yejin Choi
  5. Kyunghyun Cho
  6. Luke S. Zettlemoyer
  7. Christopher D. Manning
  8. Percy Liang

In LLM Agents & Tool Use

  1. Endang Wahyu Pamungkas
  2. Jianfeng Gao
  3. Kyunghyun Cho
  4. Mohit Bansal
  5. Jason Aaron Edward Weston
  6. Tong Niu
  7. Maxine Eskénazi
  8. Tiancheng Zhao

Citations in the corpus