Attentional Encoder Network for Targeted Sentiment Classification

By Youwei Song, Jiahai Wang, Tao Jiang, Zhiyue Liu, Yanghui Rao. 2019

319 citations recorded by the source corpus.

Targeted sentiment classification aims at determining the sentimental tendency towards specific targets. Most of the previous approaches model context and target words using recurrent neural networks such as LSTM in conjunction with attention mechanisms. However, LSTM networks are difficult to parallelize because of their sequential nature. Moreover, since full backpropagation over the sequence requires large amounts of memory, essentially every implementation of backpropagation through time is the truncated version, which brings difficulty in remembering long-term patterns. To address these issues, this paper propose an Attentional Encoder Network (AEN) for targeted sentiment classification. Contrary to previous LSTM based works, AEN eschews complex recurrent neural networks and employs attention based encoders for the modeling between context and target, which can excavate the rich introspective and interactive semantic information from the word embeddings without considering the distance between words. This paper also raise the label unreliability issue and introduce label smoothing regularization term to the loss function for encouraging the model to be less confident with the training labels. Experimental results on three benchmark datasets demonstrate that our model achieves comparable or superior performances with a lightweight model size. 1

Subfields: Artificial Intelligence, Management Science and Operations Research, Model Architectures, Sentiment & Opinion Analysis

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Lei-tai Chen
  2. Sneha Chaudhari
  3. Xingjiao Wu
  4. Varun Mithal
  5. Ruifeng Xu
  6. Tianlong Ma
  7. Rohan Ramanath
  8. Ao Feng

In Management Science and Operations Research

  1. Ruifeng Xu
  2. Min Yang
  3. Xiang Ao

In Model Architectures

  1. Sneha Chaudhari
  2. Varun Mithal
  3. Ruifeng Xu
  4. Rohan Ramanath
  5. Min Yang
  6. Gungor Polatkan
  7. Xiang Ao

Citations in the corpus