Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading

By Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, William B. Dolan, Yejin Choi, Jianfeng Gao. 2019

111 citations recorded by the source corpus.

Although neural conversational models are effective in learning how to produce fluent responses, their primary challenge lies in knowing what to say to make the conversation contentful and non-vacuous. We present a new end-to-end approach to contentful neural conversation that jointly models response generation and on-demand machine reading. The key idea is to provide the conversation model with relevant long-form text on the fly as a source of external knowledge. The model performs QA-style reading comprehension on this text in response to each conversational turn, thereby allowing for more focused integration of external knowledge than has been possible in prior approaches. To support further research on knowledge-grounded conversation, we introduce a new large-scale conversation dataset grounded in external web pages (2.8M turns, 7.4M sentences of grounding). Both human evaluation and automated metrics show that our approach results in more contentful responses compared to a variety of previous methods, improving both the informativeness and diversity of generated output.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Retrieval-Augmented Generation, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Mohit Bansal
  3. Yejin Choi
  4. Jason Aaron Edward Weston
  5. Luke S. Zettlemoyer
  6. Percy Liang
  7. Hannaneh Hajishirzi
  8. Noah A. Smith

In Computer Vision and Pattern Recognition

  1. Jianfeng Gao
  2. Luc Van Gool
  3. Mohit Bansal
  4. Dacheng Tao
  5. Trevor Darrell
  6. Xiaogang Wang
  7. Jason Aaron Edward Weston
  8. Ming-Hsuan Yang

In Retrieval-Augmented Generation

  1. Arthur Szlam
  2. Jianfeng Gao
  3. Jason Aaron Edward Weston
  4. Michel Galley
  5. Hannaneh Hajishirzi
  6. Eric P. Xing
  7. Antoine Bordes
  8. Gunhee Kim

In Natural Language Processing

  1. Jason Aaron Edward Weston
  2. Yejin Choi
  3. Jianfeng Gao
  4. Mohit Bansal
  5. Luke S. Zettlemoyer
  6. Y-Lan Boureau
  7. Hannaneh Hajishirzi
  8. Kurt Shuster

Citations in the corpus