Reformulating Unsupervised Style Transfer as Paraphrase Generation

By Kalpesh Krishna, John Wieting, Mohit Iyyer. 2020

281 citations recorded by the source corpus.

Modern NLP defines the task of style transfer as modifying the style of a given sentence without appreciably changing its semantics, which implies that the outputs of style transfer systems should be paraphrases of their inputs. However, many existing systems purportedly designed for style transfer inherently warp the input's meaning through attribute transfer, which changes semantic properties such as sentiment. In this paper, we reformulate unsupervised style transfer as a paraphrase generation problem, and present a simple methodology based on fine-tuning pretrained language models on automatically generated paraphrase data. Despite its simplicity, our method significantly outperforms state-of-the-art style transfer systems on both human and automatic evaluations. We also survey 23 style transfer papers and discover that existing automatic metrics can be easily gamed and propose fixed variants. Finally, we pivot to a more real-world style transfer setting by collecting a large dataset of 15M sentences in 11 diverse styles, which we use for an in-depth analysis of our system.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Natural Language Processing, Natural Language Generation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Percy Liang
  3. Jianfeng Gao
  4. Graham Neubig
  5. Luke S. Zettlemoyer
  6. Yejin Choi
  7. Noah A. Smith
  8. Yoshua Bengio

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Ming-Hsuan Yang
  5. Xiaogang Wang
  6. Jitendra Malik
  7. Mohit Bansal
  8. Alan L. Yuille

In Natural Language Processing

  1. Graham Neubig
  2. Mohit Bansal
  3. Percy Liang
  4. Yulia Tsvetkov
  5. Yejin Choi
  6. Luke S. Zettlemoyer
  7. Jianfeng Gao
  8. Noah A. Smith

In Natural Language Generation

  1. Marzena Karpinska
  2. Machel Reid
  3. Victor Zhong
  4. Dong Nguyen
  5. Anna Wegmann
  6. Mohit Iyyer
  7. Dan Jurafsky
  8. Luke Melas-Kyriazi

Citations in the corpus