Harnessing Deep Neural Networks with Logic Rules

By Zhiting Hu, Xuezhe Ma, Zhengzhong Liu, Eduard H. Hovy, Eric P. Xing. 2016

641 citations recorded by the source corpus.

Combining deep neural networks with structured logic rules is desirable to harness flexibility and reduce uninterpretability of the neural models. We propose a general framework capable of enhancing various types of neural networks (e.g., CNNs and RNNs) with declarative first-order logic rules. Specifically, we develop an iterative distillation method that transfers the structured information of logic rules into the weights of neural networks. We deploy the framework on a CNN for sentiment analysis, and an RNN for named entity recognition. With a few highly intuitive rules, we obtain substantial improvements and achieve state-of-the-art or comparable results to previous best-performing systems.

Subfields: Artificial Intelligence, Knowledge Graphs & Representation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Percy Liang
  3. Yoshua Bengio
  4. Jianfeng Gao
  5. Luke S. Zettlemoyer
  6. Yejin Choi
  7. Quoc V. Le
  8. Graham Neubig

In Knowledge Graphs & Representation

  1. Peter Clark
  2. Oyvind Tafjord
  3. A.S. d'Avila Garcez
  4. Song-Chun Zhu
  5. Quanshi Zhang
  6. Luciano Serafini
  7. Sebastian Riedel
  8. Tim Rocktaschel

Citations in the corpus