Retrieval Augmentation Reduces Hallucination in Conversation

By Kurt Shuster, Spencer Poff, Moya Chen, Douwe Kiela, Jason Aaron Edward Weston. 2021

1,126 citations recorded by the source corpus.

Despite showing increasingly human-like conversational abilities, state-of-the-art dialogue models often suffer from factual incorrectness and hallucination of knowledge (Roller et al., 2020). In this work we explore the use of neural-retrieval-in-the-loop architectures - recently shown to be effective in open-domain QA (Lewis et al., 2020b; Izacard and Grave, 2020) - for knowledge-grounded dialogue, a task that is arguably more challenging as it requires querying based on complex multi-turn dialogue context and generating conversationally coherent responses. We study various types of architectures with multiple components - retrievers, rankers, and encoder-decoders - with the goal of maximizing knowledgeability while retaining conversational ability. We demonstrate that our best models obtain state-of-the-art performance on two knowledge-grounded conversational tasks. The models exhibit open-domain conversational capabilities, generalize effectively to scenarios not within the training data, and, as verified by human evaluations, substantially reduce the well-known problem of knowledge hallucination in state-of-the-art chatbots.

Subfields: Artificial Intelligence, Retrieval-Augmented Generation, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Luke S. Zettlemoyer
  4. Percy Liang
  5. Yejin Choi
  6. Hannaneh Hajishirzi
  7. Jason Aaron Edward Weston
  8. Quoc V. Le

In Retrieval-Augmented Generation

  1. Hannaneh Hajishirzi
  2. Sebastian Riedel
  3. Akari Asai
  4. Danqi Chen
  5. Jason Aaron Edward Weston
  6. Wen-tau Yih
  7. Matei A. Zaharia
  8. Christopher Potts

In Natural Language Processing

  1. Jason Aaron Edward Weston
  2. Mohit Bansal
  3. Yejin Choi
  4. Jianfeng Gao
  5. Luke S. Zettlemoyer
  6. Hannaneh Hajishirzi
  7. Graham Neubig
  8. Caiming Xiong

Citations in the corpus