End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering

By Devendra Singh Sachan, Siva Reddy, William L. Hamilton, Chris Dyer, Dani Yogatama. 2021

192 citations recorded by the source corpus.

We present an end-to-end differentiable training method for retrieval-augmented open-domain question answering systems that combine information from multiple retrieved documents when generating answers. We model retrieval decisions as latent variables over sets of relevant documents. Since marginalizing over sets of retrieved documents is computationally hard, we approximate this using an expectation-maximization algorithm. We iteratively estimate the value of our latent variable (the set of relevant documents for a given question) and then use this estimate to update the retriever and reader parameters. We hypothesize that such end-to-end training allows training signals to flow to the reader and then to the retriever better than staged-wise training. This results in a retriever that is able to select more relevant documents for a question and a reader that is trained on more accurate documents to generate an answer. Experiments on three benchmark datasets demonstrate that our proposed method outperforms all existing approaches of comparable size by 2-3% absolute exact match points, achieving new state-of-the-art results. Our results also demonstrate the feasibility of learning to retrieve to improve answer generation without explicit supervision of retrieval decisions.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Information Systems, Retrieval-Augmented Generation, Information Retrieval & Search

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Luke S. Zettlemoyer
  2. Mohit Bansal
  3. Jianfeng Gao
  4. Graham Neubig
  5. Percy Liang
  6. Hannaneh Hajishirzi
  7. Yoshua Bengio
  8. Quoc V. Le

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Andrew Zisserman
  5. Ming-Hsuan Yang
  6. Cordelia Schmid
  7. Xiaogang Wang
  8. Jitendra Malik

In Information Systems

  1. Sebastian Riedel
  2. Luyu Gao
  3. Danqi Chen
  4. Wen-tau Yih
  5. Graham Neubig
  6. Luke S. Zettlemoyer
  7. Jamie Callan
  8. Christopher D. Manning

In Retrieval-Augmented Generation

  1. Sebastian Riedel
  2. Danqi Chen
  3. Wen-tau Yih
  4. Fabio Petroni
  5. Luyu Gao
  6. Jamie Callan
  7. Luke S. Zettlemoyer
  8. Patrick Lewis

In Information Retrieval & Search

  1. Sebastian Riedel
  2. Wen-tau Yih
  3. Danqi Chen
  4. Luyu Gao
  5. Edouard Grave
  6. Fabio Petroni
  7. Gautier Izacard
  8. Jamie Callan

Citations in the corpus