BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis

By Hu Xu, Bing Liu, Lei Shu, Philip S. Yu. 2019

791 citations recorded by the source corpus.

Question-answering plays an important role in e-commerce as it allows potential customers to actively seek crucial information about products or services to help their purchase decision making. Inspired by the recent success of machine reading comprehension (MRC) on formal documents, this paper explores the potential of turning customer reviews into a large source of knowledge that can be exploited to answer user questions. We call this problem Review Reading Comprehension (RRC). To the best of our knowledge, no existing work has been done on RRC. In this work, we first build an RRC dataset called ReviewRC based on a popular benchmark for aspect-based sentiment analysis. Since ReviewRC has limited training examples for RRC (and also for aspect-based sentiment analysis), we then explore a novel post-training approach on the popular language model BERT to enhance the performance of fine-tuning of BERT for RRC. To show the generality of the approach, the proposed post-training is also applied to some other review-based tasks such as aspect extraction and aspect sentiment classification in aspect-based sentiment analysis. Experimental results demonstrate that the proposed post-training is highly effective.

Subfields: Artificial Intelligence, Large Language Models, Question Answering & Reading Comprehension, Sentiment & Opinion Analysis

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Bing Liu
  2. Minlie Huang
  3. Zixuan Ke
  4. Jianfeng Gao
  5. Hu Xu
  6. Mohit Bansal
  7. Bin Liu
  8. Lei Shu

In Large Language Models

  1. Zixuan Ke
  2. Ming Zhou
  3. Bin Liu
  4. Hu Xu
  5. Lei Shu
  6. Minlie Huang
  7. Bing Liu
  8. Yue Zhang

In Question Answering & Reading Comprehension

  1. Zixuan Ke
  2. Kathleen M. Carley
  3. Binxuan Huang
  4. Hu Xu
  5. Bing Liu

In Sentiment & Opinion Analysis

  1. Zixuan Ke
  2. Hu Xu
  3. Bing Liu
  4. Lei Shu
  5. Bin Liu
  6. Kathleen M. Carley
  7. Binxuan Huang
  8. Eduard H. Hovy

Citations in the corpus