Tensor Fusion Network for Multimodal Sentiment Analysis

By Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, Louis-philippe Morency. 2017

1,841 citations recorded by the source corpus.

Multimodal sentiment analysis is an increasingly popular research area, which extends the conventional language-based definition of sentiment analysis to a multimodal setup where other relevant modalities accompany language. In this paper, we pose the problem of multimodal sentiment analysis as modeling intra-modality and inter-modality dynamics. We introduce a novel model, termed Tensor Fusion Networks, which learns both such dynamics end-to-end. The proposed approach is tailored for the volatile nature of spoken language in online videos as well as accompanying gestures and voice. In the experiments, our model outperforms state-of-the-art approaches for both multimodal and unimodal sentiment analysis.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Experimental and Cognitive Psychology, Multimodal Learning, Sentiment & Opinion Analysis

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Soujanya Poria
  2. Erik Cambria
  3. Percy Liang
  4. Louis-philippe Morency
  5. Devamanyu Hazarika
  6. Mohit Bansal
  7. Ruslan Salakhutdinov
  8. Jianfeng Gao

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Percy Liang
  3. Dacheng Tao
  4. Trevor Darrell
  5. Xiaogang Wang
  6. Ming-Hsuan Yang
  7. Louis-philippe Morency
  8. Jitendra Malik

In Experimental and Cognitive Psychology

  1. Soujanya Poria
  2. Erik Cambria
  3. Navonil Majumder
  4. Devamanyu Hazarika
  5. Rada Mihalcea
  6. Percy Liang
  7. Louis-philippe Morency
  8. Amir Zadeh

In Multimodal Learning

  1. Soujanya Poria
  2. Louis-philippe Morency
  3. Percy Liang
  4. Amir Zadeh
  5. Devamanyu Hazarika
  6. Erik Cambria
  7. Xiaodong He
  8. Jiele Wu

In Sentiment & Opinion Analysis

  1. Soujanya Poria
  2. Percy Liang
  3. Devamanyu Hazarika
  4. Amir Zadeh
  5. Erik Cambria
  6. Louis-philippe Morency
  7. Navonil Majumder
  8. Rada Mihalcea

Citations in the corpus