Commonsense Knowledge Aware Conversation Generation with Graph Attention

By Hao Zhou, Tom Young, Minlie Huang, Haizhou Zhao, Jingfang Xu, Xiaoyan Zhu. 2018

523 citations recorded by the source corpus.

Commonsense knowledge is vital to many natural language processing tasks. In this paper, we present a novel open-domain conversation generation model to demonstrate how large-scale commonsense knowledge can facilitate language understanding and generation. Given a user post, the model retrieves relevant knowledge graphs from a knowledge base and then encodes the graphs with a static graph attention mechanism, which augments the semantic information of the post and thus supports better understanding of the post. Then, during word generation, the model attentively reads the retrieved knowledge graphs and the knowledge triples within each graph to facilitate better generation through a dynamic graph attention mechanism. This is the first attempt that uses large-scale commonsense knowledge in conversation generation. Furthermore, unlike existing models that use knowledge triples (entities) separately and independently, our model treats each knowledge graph as a whole, which encodes more structured, connected semantic information in the graphs. Experiments show that the proposed model can generate more appropriate and informative responses than state-of-the-art baselines.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Dialogue & Conversational AI, Knowledge Graphs & Representation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Minlie Huang
  3. Mohit Bansal
  4. Zhiyuan Liu
  5. Maosong Sun
  6. Yejin Choi
  7. Bing Liu
  8. Graham Neubig

In Computer Vision and Pattern Recognition

  1. Dacheng Tao
  2. Jianfeng Gao
  3. Luc Van Gool
  4. Bernt Schiele
  5. Trevor Darrell
  6. Xiaogang Wang
  7. Yi Yang
  8. Cordelia Schmid

In Dialogue & Conversational AI

  1. Bing Liu
  2. Minlie Huang
  3. Sahisnu Mazumder
  4. Xiaoyan Zhu
  5. Can Xu
  6. Dilek Z. Hakkani-Tür
  7. Behnam Hedayatnia
  8. Dongyan Zhao

In Knowledge Graphs & Representation

  1. Minlie Huang
  2. Xiang Ren
  3. Shirui Pan
  4. Bing Liu
  5. Bill Yuchen Lin
  6. Chenguang Zhu
  7. Meng Jiang
  8. Jian Guan

Citations in the corpus