Neural versus Phrase-Based Machine Translation Quality: a Case Study

By Luisa Bentivogli, Arianna Bisazza, Mauro Cettolo, Marcello Federico. 2016

344 citations recorded by the source corpus.

Within the field of Statistical Machine Translation (SMT), the neural approach (NMT) has recently emerged as the first technology able to challenge the long-standing dominance of phrase-based approaches (PBMT). In particular, at the IWSLT 2015 evaluation campaign, NMT outperformed well established state-of-the-art PBMT systems on English-German, a language pair known to be particularly hard because of morphology and syntactic differences. To understand in what respects NMT provides better translation quality than PBMT, we perform a detailed analysis of neural versus phrase-based SMT outputs, leveraging high quality post-edits performed by professional translators on the IWSLT data. For the first time, our analysis provides useful insights on what linguistic phenomena are best modeled by neural models -- such as the reordering of verbs -- while pointing out other aspects that remain to be improved.

Subfields: Artificial Intelligence, Machine Translation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yonatan Belinkov
  2. Graham Neubig
  3. Felix Stahlberg
  4. Philipp Koehn
  5. Mohit Bansal
  6. Luke S. Zettlemoyer
  7. Kyunghyun Cho
  8. Jianfeng Gao

In Machine Translation

  1. Yonatan Belinkov
  2. Philipp Koehn
  3. Felix Stahlberg
  4. Nadir Durrani
  5. Hassan Sajjad
  6. James R. Glass
  7. Fahim Dalvi
  8. Matteo Negri

Citations in the corpus