A Survey of Knowledge-enhanced Text Generation

By W. Yu, Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang. 2020

345 citations recorded by the source corpus.

The goal of text-to-text generation is to make machines express like a human in many applications such as conversation, summarization, and translation. It is one of the most important yet challenging tasks in natural language processing (NLP). Various neural encoder-decoder models have been proposed to achieve the goal by learning to map input text to output text. However, the input text alone often provides limited knowledge to generate the desired output, so the performance of text generation is still far from satisfaction in many real-world scenarios. To address this issue, researchers have considered incorporating (i) internal knowledge embedded in the input text and (ii) external knowledge from outside sources such as knowledge base and knowledge graph into the text generation system. This research topic is known as knowledge-enhanced text generation. In this survey, we present a comprehensive review of the research on this topic over the past five years. The main content includes two parts: (i) general methods and architectures for integrating knowledge into text generation; (ii) specific techniques and applications according to different forms of knowledge data. This survey can have broad audiences, researchers and practitioners, in academia and industry.

Subfields: Artificial Intelligence, Natural Language Processing, Natural Language Generation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Graham Neubig
  2. Pengfei Liu
  3. Mohit Bansal
  4. Xiang Ren
  5. Percy Liang
  6. Jianfeng Gao
  7. Chenguang Zhu
  8. Luke S. Zettlemoyer

In Natural Language Processing

  1. Graham Neubig
  2. Pengfei Liu
  3. Xiang Ren
  4. Yang Liu
  5. Jinlan Fu
  6. Chenguang Zhu
  7. Mohit Bansal
  8. Luke S. Zettlemoyer

In Natural Language Generation

  1. Pengfei Liu
  2. Xiang Ren
  3. Bill Yuchen Lin
  4. Dan Roth
  5. Graham Neubig

Citations in the corpus