Soft Layer-Specific Multi-Task Summarization with Entailment and Question Generation

By Han Guo, Ramakanth Pasunuru, Mohit Bansal. 2018

143 citations recorded by the source corpus.

An accurate abstractive summary of a document should contain all its salient information and should be logically entailed by the input document. We improve these important aspects of abstractive summarization via multi-task learning with the auxiliary tasks of question generation and entailment generation, where the former teaches the summarization model how to look for salient questioning-worthy details, and the latter teaches the model how to rewrite a summary which is a directed-logical subset of the input document. We also propose novel multi-task architectures with high-level (semantic) layer-specific sharing across multiple encoder and decoder layers of the three tasks, as well as soft-sharing mechanisms (and show performance ablations and analysis examples of each contribution). Overall, we achieve statistically significant improvements over the state-of-the-art on both the CNN/DailyMail and Gigaword datasets, as well as on the DUC-2002 transfer setup. We also present several quantitative and qualitative analysis studies of our model’s learned saliency and entailment skills.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Question Answering & Reading Comprehension, Summarization

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Yejin Choi
  3. Caiming Xiong
  4. Percy Liang
  5. Luke S. Zettlemoyer
  6. Jianfeng Gao
  7. Noah A. Smith
  8. Hannaneh Hajishirzi

In Computer Vision and Pattern Recognition

  1. Yejin Choi
  2. Jianfeng Gao
  3. Luc Van Gool
  4. Mohit Bansal
  5. Trevor Darrell
  6. Dacheng Tao
  7. Caiming Xiong
  8. Xiaogang Wang

In Question Answering & Reading Comprehension

  1. Caiming Xiong
  2. Bryan McCann
  3. Yejin Choi
  4. Jianfeng Gao
  5. Greg Durrett
  6. Chandra Bhagavatula
  7. Andreas Vlachos
  8. Richard Socher

In Summarization

  1. Bryan McCann
  2. Fei Liu
  3. Yejin Choi
  4. Iryna Gurevych
  5. Greg Durrett
  6. Andreas Vlachos
  7. Richard Socher
  8. Hardy Hardy

Citations in the corpus