Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation

By Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, Yoshua Bengio. 2014

26,848 citations recorded by the source corpus.

In this paper, we propose a novel neural network model called RNN Encoder‐ Decoder that consists of two recurrent neural networks (RNN). One RNN encodes a sequence of symbols into a fixedlength vector representation, and the other decodes the representation into another sequence of symbols. The encoder and decoder of the proposed model are jointly trained to maximize the conditional probability of a target sequence given a source sequence. The performance of a statistical machine translation system is empirically found to improve by using the conditional probabilities of phrase pairs computed by the RNN Encoder‐Decoder as an additional feature in the existing log-linear model. Qualitatively, we show that the proposed model learns a semantically and syntactically meaningful representation of linguistic phrases.

Subfields: Artificial Intelligence, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Yoshua Bengio
  4. Percy Liang
  5. Quoc V. Le
  6. Luke S. Zettlemoyer
  7. Graham Neubig
  8. Kyunghyun Cho

In Natural Language Processing

  1. Mohit Bansal
  2. Graham Neubig
  3. Jianfeng Gao
  4. Kyunghyun Cho
  5. Luke S. Zettlemoyer
  6. Percy Liang
  7. Richard Socher
  8. Yejin Choi

Citations in the corpus