Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering

By Gautier Izacard, Edouard Grave. Conference of the European Chapter of the Association for Computational Linguistics, 2020

1,909 citations recorded by the source corpus.

Generative models for open domain question answering have proven to be competitive, without resorting to external knowledge. While promising, this approach requires to use models with billions of parameters, which are expensive to train and query. In this paper, we investigate how much these models can benefit from retrieving text passages, potentially containing evidence. We obtain state-of-the-art results on the Natural Questions and TriviaQA open benchmarks. Interestingly, we observe that the performance of this method significantly improves when increasing the number of retrieved passages. This is evidence that sequence-to-sequence models offers a flexible framework to efficiently aggregate and combine evidence from multiple passages.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Retrieval-Augmented Generation, Natural Language Processing

View Paper: https://arxiv.org/abs/2007.01282

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Jianfeng Gao
  4. Percy Liang
  5. Yejin Choi
  6. Hannaneh Hajishirzi
  7. Graham Neubig
  8. Noah A. Smith

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Xiaogang Wang
  5. Ming-Hsuan Yang
  6. Jitendra Malik
  7. Jianfeng Gao
  8. Andrew Zisserman

In Retrieval-Augmented Generation

  1. Hannaneh Hajishirzi
  2. Sebastian Riedel
  3. Akari Asai
  4. Danqi Chen
  5. Luyu Gao
  6. Jamie Callan
  7. Jason Aaron Edward Weston
  8. Wen-tau Yih

In Natural Language Processing

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Jianfeng Gao
  4. Yejin Choi
  5. Hannaneh Hajishirzi
  6. Graham Neubig
  7. Jason Aaron Edward Weston
  8. Percy Liang

Citations in the corpus