JEIDA’s test - sets for quality evaluation of MT systems

By Hitoshi Isahara. 1995

Subfields: Evaluation & Benchmarks, Machine Translation

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Evaluation & Benchmarks

1. Jan-Thorsten Peter
2. James R. Glass
3. Yonatan Belinkov
4. Aljoscha Burchardt

In Machine Translation

1. Yonatan Belinkov
2. James R. Glass
3. Jesse Vig
4. Hassan Sajjad
5. Fahim Dalvi
6. Nadir Durrani

Citations in the corpus

• Analysis Methods in Neural Language Processing: A Survey (2018, background): “, 1996), especially for evaluating MT systems (King and Falkedal, 1990; Isahara, 1995; Koh et al., 2001).”
• A Linguistic Evaluation of Rule-Based, Phrase-Based, and Neural MT Engines (2017, background): “Apart from several singular attempts (King and Falkedal, 1990; Isahara, 1995; Koh et al., 2001, etc.) broadly-defined test suites have not generally been used in MT research.”
• A test suite for evaluation of English-to-Korean machine translation systems (2001, background): “As pointed out in Isahara (1995), this yes/no question about a linguistic phenomenon enabled us to evaluate MT systems objectively.”