A Systematic Comparison of Smoothing Techniques for Sentence-Level BLEU

By Boxing Chen, Colin Cherry. 2014

257 citations recorded by the source corpus.

BLEU is the de facto standard machine translation (MT) evaluation metric. How- ever, because BLEU computes a geo- metric mean of n-gram precisions, it of- ten correlates poorly with human judg- ment on the sentence-level. There- fore, several smoothing techniques have been proposed. This paper systemati- cally compares 7 smoothing techniques for sentence-level BLEU. Three of them are first proposed in this paper, and they correlate better with human judgments on the sentence-level than other smoothing techniques. Moreover, we also compare the performance of using the 7 smoothing techniques in statistical machine transla- tion tuning.

Subfields: Artificial Intelligence, Evaluation & Benchmarks, Machine Translation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Luke S. Zettlemoyer
  3. Mohit Bansal
  4. Percy Liang
  5. Kyunghyun Cho
  6. Noah A. Smith
  7. Graham Neubig
  8. Yoshua Bengio

In Evaluation & Benchmarks

  1. Marco Turchi
  2. Matteo Negri
  3. Robin Jia
  4. Ondrej Bojar
  5. Jianfeng Gao
  6. Jordan L. Boyd-Graber
  7. Kyunghyun Cho
  8. Dallas Card

In Machine Translation

  1. Ondrej Bojar
  2. Matteo Negri
  3. Marco Turchi
  4. Jianfeng Gao
  5. Jindřich Libovický
  6. Jindřich Helcl
  7. Jian-Yun Nie
  8. Marcello Federico

Citations in the corpus