PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Text

By Haitian Sun, Tania Bedrax-Weiss, William W. Cohen. 2019

464 citations recorded by the source corpus.

We consider open-domain question answering (QA) where answers are drawn from either a corpus, a knowledge base (KB), or a combination of both of these. We focus on a setting in which a corpus is supplemented with a large but incomplete KB, and on questions that require non-trivial (e.g., “multi-hop”) reasoning. We describe PullNet, an integrated framework for (1) learning what to retrieve and (2) reasoning with this heterogeneous information to find the best answer. PullNet uses an iterative process to construct a question-specific subgraph that contains information relevant to the question. In each iteration, a graph convolutional network (graph CNN) is used to identify subgraph nodes that should be expanded using retrieval (or “pull”) operations on the corpus and/or KB. After the subgraph is complete, another graph CNN is used to extract the answer from the subgraph. This retrieve-and-reason process allows us to answer multi-hop questions using large KBs and corpora. PullNet is weakly supervised, requiring question-answer pairs but not gold inference paths. Experimentally PullNet improves over the prior state-of-the art, and in the setting where a corpus is used with incomplete KB these improvements are often dramatic. PullNet is also often superior to prior systems in a KB-only setting or a text-only setting.

Subfields: Artificial Intelligence, Retrieval-Augmented Generation, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Percy Liang
  4. Jianfeng Gao
  5. Hannaneh Hajishirzi
  6. Caiming Xiong
  7. Yejin Choi
  8. Graham Neubig

In Retrieval-Augmented Generation

  1. Hannaneh Hajishirzi
  2. Danqi Chen
  3. Akari Asai
  4. Wen-tau Yih
  5. Jason Aaron Edward Weston
  6. William W. Cohen
  7. Sewon Min
  8. Bhuwan Dhingra

In Natural Language Processing

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Hannaneh Hajishirzi
  4. Percy Liang
  5. Caiming Xiong
  6. Graham Neubig
  7. Yejin Choi
  8. Jianfeng Gao

Citations in the corpus