Bleu: a Method for Automatic Evaluation of Machine Translation

By Kishore Papineni, Salim Roukos, Tomás Ward, Wei-Jing Zhu. 2002

33,928 citations recorded by the source corpus.

Human evaluations of machine translation are extensive but expensive. Human evaluations can take months to finish and involve human labor that can not be reused. We propose a method of automatic machine translation evaluation that is quick, inexpensive, and language-independent, that correlates highly with human evaluation, and that has little marginal cost per run. We present this method as an automated understudy to skilled human judges which substitutes for them when there is need for quick or frequent evaluations.

Subfields: Artificial Intelligence, Natural Language Processing, Evaluation & Benchmarks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Luke S. Zettlemoyer
  4. Percy Liang
  5. Graham Neubig
  6. Yejin Choi
  7. Yoshua Bengio
  8. Kyunghyun Cho

In Natural Language Processing

  1. Mohit Bansal
  2. Graham Neubig
  3. Jianfeng Gao
  4. Luke S. Zettlemoyer
  5. Yejin Choi
  6. Kyunghyun Cho
  7. Percy Liang
  8. Noah A. Smith

In Evaluation & Benchmarks

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Yejin Choi
  4. Elizabeth Clark
  5. Graham Neubig
  6. Luke S. Zettlemoyer
  7. Lucia Specia
  8. Percy Liang

Citations in the corpus