Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models
By Iulian Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C. Courville, Joelle Pineau. 2015
1,811 citations recorded by the source corpus.
We investigate the task of building open domain, conversational dialogue systems based on large dialogue corpora using generative models. Generative models produce system responses that are autonomously generated word-by-word, opening up the possibility for realistic, flexible interactions. In support of this goal, we extend the recently proposed hierarchical recurrent encoder-decoder neural network to the dialogue domain, and demonstrate that this model is competitive with state-of-the-art neural language models and back-off n-gram models. We investigate the limitations of this and similar approaches, and show how its performance can be improved by bootstrapping the learning from a larger question-answer pair corpus and from pretrained word embeddings.
Subfields: Artificial Intelligence, Natural Language Processing, LLM Agents & Tool Use
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Jianfeng Gao
- Mohit Bansal
- Jason Aaron Edward Weston
- Percy Liang
- Yoshua Bengio
- Luke S. Zettlemoyer
- Yejin Choi
- Kyunghyun Cho
In Natural Language Processing
- Jianfeng Gao
- Jason Aaron Edward Weston
- Mohit Bansal
- Yejin Choi
- Kyunghyun Cho
- Luke S. Zettlemoyer
- Christopher D. Manning
- Percy Liang
In LLM Agents & Tool Use
- Endang Wahyu Pamungkas
- Jianfeng Gao
- Kyunghyun Cho
- Mohit Bansal
- Jason Aaron Edward Weston
- Tong Niu
- Maxine Eskénazi
- Tiancheng Zhao
Citations in the corpus
- The Woman Worked as a Babysitter: On Biases in Language Generation (2019, background): “Language models are a fundamental component of NLG that are widely used in downstream tasks such as machine translation (Koehn, 2009), dialogue generation (Serban et al., 2016), and story generation (Yao et al.”
- Towards a Human-like Open-Domain Chatbot (2020, background): “End-to-end neural network approaches (Shang et al., 2015; Vinyals and Le, 2015; Sordoni et al., 2015; Serban et al., 2016; Zhang et al., 2019), on the other hand, offer the simplicity of a single learned model.”
- Anticipating Safety Issues in E2E Conversational AI: Framework and Tooling (2021, methodology): “These models are typically trained in the popular encoder-decoder paradigm, which was first introduced for this task by Vinyals & Le (2015); Shang et al. (2015); Serban et al. (2016).”
- Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions (2020, background): “Nevertheless, a number of studies do report automatic metrics, sometimes without human studies (Lowe et al., 2015; Serban et al., 2016; Parthasarathi and Pineau, 2018).”
- ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons (2019, background): “Nevertheless, a number of studies do report automatic metrics, without human studies (Serban et al. 2016; Parthasarathi and Pineau 2018).”
- Towards Exploiting Background Knowledge for Building Conversation Systems (2018, methodology): “We will not consider HRED for the following discussion.”
- A Knowledge-Grounded Neural Conversation Model (2017, methodology): “This paradigm was introduced by models (Sordoni et al., 2015; Serban et al., 2016; Shang et al., 2015; Vinyals and Le, 2015; Li et al., 2016a,b).”
- Efficient Natural Language Response Suggestion for Smart Reply (2017, background): “End-to-end systems avoid using hand-crafted explicit representations, by learning to map to and from natural language via implicit internal vector representations [19, 25].”
- Unbounded cache model for online language modeling with open vocabulary (2017, background): “Language models are a core component of many natural language processing applications such as machine translation [3], speech recognition [2] or dialogue agents [50].”
- Does Gender Matter? Towards Fairness in Dialogue Systems (2019, background): “Dialogue systems are often built based on real human conversational data through machine learning especially deep learning techniques (Shang et al., 2015; Serban et al., 2016; Serban et al., 2017).”
- Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog (2019, methodology): “[53, 52, 43, 20]), on different datasets (movie dialogs [9] and Reddit [20]).”
- Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators (2019, methodology): “Our method extends the strategy employed by Shao et al. (2017) utilizing a trained model as the reranking function and is similar to Holtzman et al. (2018) but with different kind of trained model.”
- Ethical Challenges in Data-Driven Dialogue Systems (2017, methodology): “ of such content, it can be expected that these behaviours will be encoded in the underlying model. To this end, we run another experiment. We train two commonly used endto-end dialogue models, HRED (Serban et al. 2016) and VHRED (Serban et al. 2017c), on the Twitter dataset and sample responses usi”
- Human-centric Dialog Training via Offline Reinforcement Learning (2020, methodology): “For model architectures, we focused on hierarchical sequence-to-sequence models (Serban et al., 2016, 2017b; Park et al., 2018) because they were found to be more effective for the datasets under consideration than e.g. Trans-formers (Saleh et al., 2019).”
- Visual Dialog (2016, background): “While some of the earliest developed chatbots were rule-based [56], end-to-end learning based approaches are now being actively explored [7,9,19,24,45,46,53].”