Generation-Augmented Retrieval for Open-Domain Question Answering

By Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Weizhu Chen. 2020

323 citations recorded by the source corpus.

We propose Generation-Augmented Retrieval (GAR) for answering open-domain questions, which augments a query through text generation of heuristically discovered relevant contexts without external resources as supervision. We demonstrate that the generated contexts substantially enrich the semantics of the queries and GAR with sparse representations (BM25) achieves comparable or better performance than state-of-the-art dense retrieval methods such as DPR. We show that generating diverse contexts for a query is beneficial as fusing their results consistently yields better retrieval accuracy. Moreover, as sparse and dense representations are often complementary, GAR can be easily combined with DPR to achieve even better performance. GAR achieves state-of-the-art performance on Natural Questions and TriviaQA datasets under the extractive QA setup when equipped with an extractive reader, and consistently outperforms other retrieval methods when the same generative reader is used.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Retrieval-Augmented Generation, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Mohit Bansal
  3. Luke S. Zettlemoyer
  4. Graham Neubig
  5. Percy Liang
  6. Hannaneh Hajishirzi
  7. Yejin Choi
  8. Caiming Xiong

In Computer Vision and Pattern Recognition

  1. Jianfeng Gao
  2. Luc Van Gool
  3. Dacheng Tao
  4. Trevor Darrell
  5. Cordelia Schmid
  6. Xiaogang Wang
  7. Andrew Zisserman
  8. Ming-Hsuan Yang

In Retrieval-Augmented Generation

  1. Sebastian Riedel
  2. Luyu Gao
  3. Jamie Callan
  4. Wen-tau Yih
  5. Fabio Petroni
  6. Patrick Lewis
  7. Ruiyang Ren
  8. Jing Liu

In Natural Language Processing

  1. Jianfeng Gao
  2. Graham Neubig
  3. Luke S. Zettlemoyer
  4. Mohit Bansal
  5. Sebastian Riedel
  6. Wen-tau Yih
  7. Christopher D. Manning
  8. Jason Aaron Edward Weston

Citations in the corpus