QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering

By Michihiro Yasunaga, Hongyu Ren, Antoine Bosselut, Percy Liang, Jure Leskovec. 2021

863 citations recorded by the source corpus.

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge from large KGs, and (ii) perform joint reasoning over the QA context and KG. Here we propose a new model, QA-GNN, which addresses the above challenges through two key innovations: (i) relevance scoring, where we use LMs to estimate the importance of KG nodes relative to the given QA context, and (ii) joint reasoning, where we connect the QA context and KG to form a joint graph, and mutually update their representations through graph-based message passing. We evaluate QA-GNN on the CommonsenseQA and OpenBookQA datasets, and show its improvement over existing LM and LM+KG models, as well as its capability to perform interpretable and structured reasoning, e.g., correctly handling negation in questions.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Prompting & Reasoning, Question Answering & Reading Comprehension, Knowledge Graphs & Representation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Luke S. Zettlemoyer
  2. Percy Liang
  3. Mohit Bansal
  4. Yejin Choi
  5. Graham Neubig
  6. Noah A. Smith
  7. Hannaneh Hajishirzi
  8. Caiming Xiong

In Computer Vision and Pattern Recognition

  1. Dacheng Tao
  2. Luc Van Gool
  3. Mohit Bansal
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Andrea Vedaldi
  7. Yejin Choi
  8. Jitendra Malik

In Prompting & Reasoning

  1. Luke S. Zettlemoyer
  2. Denny Zhou
  3. Yejin Choi
  4. Hannaneh Hajishirzi
  5. Sean Welleck
  6. Xinyun Chen
  7. Michael Lewis
  8. Noah A. Smith

In Question Answering & Reading Comprehension

  1. Percy Liang
  2. Wen-tau Yih
  3. Hannaneh Hajishirzi
  4. Christopher D. Manning
  5. Yejin Choi
  6. Jure Leskovec
  7. Deng Cai
  8. Michihiro Yasunaga

In Knowledge Graphs & Representation

  1. Ronan Le Bras
  2. Jure Leskovec
  3. Yejin Choi
  4. Michihiro Yasunaga
  5. Sean Welleck
  6. Peter West
  7. Hongyu Ren
  8. Percy Liang

Citations in the corpus