Retrieve, Program, Repeat: Complex Knowledge Base Question Answering via Alternate Meta-learning

By Jian Liu, Leyang Cui, Hanmeng Liu, Dandan Huang, Yile Wang, Yue Zhang. 2020

410 citations recorded by the source corpus.

A compelling approach to complex question answering is to convert the question to a sequence of actions, which can then be executed on the knowledge base to yield the answer, aka the programmer-interpreter approach. Use similar training questions to the test question, meta-learning enables the programmer to adapt to unseen questions to tackle potential distributional biases quickly. However, this comes at the cost of manually labeling similar questions to learn a retrieval model, which is tedious and expensive. In this paper, we present a novel method that automatically learns a retrieval model alternately with the programmer from weak supervision, i.e., the system’s performance with respect to the produced answers. To the best of our knowledge, this is the first attempt to train the retrieval model with the programmer jointly. Our system leads to state-of-the-art performance on a large-scale task for complex question answering over knowledge bases. We have released our code at https://github.com/DevinJake/MARL.

Subfields: Artificial Intelligence, Molecular Biology, Retrieval-Augmented Generation, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Luke S. Zettlemoyer
  3. Percy Liang
  4. Jianfeng Gao
  5. Yejin Choi
  6. Hannaneh Hajishirzi
  7. Noah A. Smith
  8. Graham Neubig

In Molecular Biology

  1. Danqi Chen
  2. Luke S. Zettlemoyer
  3. Kyle Lo
  4. Arman Cohan
  5. Wei Dang Lu
  6. Vineet Kosaraju
  7. Jun Zhao
  8. Dawn Song

In Retrieval-Augmented Generation

  1. Tushar Khot
  2. Luke S. Zettlemoyer
  3. Yizhong Wang
  4. Niklas Muennighoff
  5. Weizhu Chen
  6. Duyu Tang
  7. Lukasz Kaiser
  8. Matt Gardner

In Natural Language Processing

  1. Mohit Bansal
  2. Matt Gardner
  3. Hannaneh Hajishirzi
  4. Jonathan Berant
  5. Luke S. Zettlemoyer
  6. Tushar Khot
  7. Ashish Sabharwal
  8. Percy Liang

Citations in the corpus