Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank

By Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, Christopher Potts. 2013

9,576 citations recorded by the source corpus.

Semantic word spaces have been very useful but cannot express the meaning of longer phrases in a principled way. Further progress towards understanding compositionality in tasks such as sentiment detection requires richer supervised training and evaluation resources and more powerful models of composition. To remedy this, we introduce a Sentiment Treebank. It includes fine grained sentiment labels for 215,154 phrases in the parse trees of 11,855 sentences and presents new challenges for sentiment compositionality. To address them, we introduce the Recursive Neural Tensor Network. When trained on the new treebank, this model outperforms all previous methods on several metrics. It pushes the state of the art in single sentence positive/negative classification from 80% up to 85.4%. The accuracy of predicting fine-grained sentiment labels for all phrases reaches 80.7%, an improvement of 9.7% over bag of features baselines. Lastly, it is the only model that can accurately capture the effects of negation and its scope at various tree levels for both positive and negative phrases.

Subfields: Artificial Intelligence, Natural Language Processing, Representation & Self-Supervised Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Luke S. Zettlemoyer
  4. Percy Liang
  5. Yoshua Bengio
  6. Yejin Choi
  7. Graham Neubig
  8. Noah A. Smith

In Natural Language Processing

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Luke S. Zettlemoyer
  4. Graham Neubig
  5. Yejin Choi
  6. Noah A. Smith
  7. Percy Liang
  8. Kyunghyun Cho

In Representation & Self-Supervised Learning

  1. Yoshua Bengio
  2. Sebastian Ruder
  3. Jianfeng Gao
  4. Ivan Vulic
  5. Ruslan Salakhutdinov
  6. Percy Liang
  7. Graham Neubig
  8. Quoc V. Le

Citations in the corpus