R3: Reinforced Ranker-Reader for Open-Domain Question Answering

By Shuohang Wang, Mo Yu, Xiaoxiao Guo, Zhiguo Wang, Tim Klinger, Shiyu Chang, G. Tesauro, Bowen Zhou, Jing Jiang. 2018

200 citations recorded by the source corpus.

In recent years researchers have achieved considerable success applying neural network methods to question answering (QA). These approaches have achieved state of the art results in simplified closed-domain settings such as the SQuAD (Rajpurkar et al. 2016) dataset, which provides a pre-selected passage, from which the answer to a given question may be extracted. More recently, researchers have begun to tackle open-domain QA, in which the model is given a question and access to a large corpus (e.g., wikipedia) instead of a pre-selected passage (Chen et al. 2017a). This setting is more complex as it requires large-scale search for relevant passages by an information retrieval component, combined with a reading comprehension model that “reads” the passages to generate an answer to the question. Performance in this setting lags well behind closed-domain performance. In this paper, we present a novel open-domain QA system called Reinforced Ranker-Reader (R3), based on two algorithmic innovations. First, we propose a new pipeline for open-domain QA with a Ranker component, which learns to rank retrieved passages in terms of likelihood of extracting the ground-truth answer to a given question. Second, we propose a novel method that jointly trains the Ranker along with an answer-extraction Reader model, based on reinforcement learning. We report extensive experimental results showing that our method significantly improves on the state of the art for multiple open-domain QA datasets.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Retrieval-Augmented Generation, Information Retrieval & Search

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Hannaneh Hajishirzi
  4. Jianfeng Gao
  5. Percy Liang
  6. Caiming Xiong
  7. Graham Neubig
  8. Yejin Choi

In Computer Vision and Pattern Recognition

  1. Hannaneh Hajishirzi
  2. Mohit Bansal
  3. Luc Van Gool
  4. Jianfeng Gao
  5. Dacheng Tao
  6. Trevor Darrell
  7. Xiaogang Wang
  8. Cordelia Schmid

In Retrieval-Augmented Generation

  1. Hannaneh Hajishirzi
  2. Sebastian Riedel
  3. Akari Asai
  4. Danqi Chen
  5. Wen-tau Yih
  6. Fabio Petroni
  7. Gautier Izacard
  8. Patrick Lewis

In Information Retrieval & Search

  1. Hannaneh Hajishirzi
  2. Sebastian Riedel
  3. Wen-tau Yih
  4. Danqi Chen
  5. Gautier Izacard
  6. Akari Asai
  7. Edouard Grave
  8. Fabio Petroni

Citations in the corpus