Encouraging Lexical Translation Consistency for Document-Level Neural Machine Translation
By Xinglin Lyu, Junhui Li, Zhengxian Gong, M. Zhang. 2021
32 citations recorded by the source corpus.
Recently a number of approaches have been proposed to improve translation performance for document-level neural machine translation (NMT). However, few are focusing on the subject of lexical translation consistency. In this paper we apply “one translation per discourse” in NMT, and aim to encourage lexical translation consistency for document-level NMT. This is done by first obtaining a word link for each source word in a document, which tells the positions where the source word appears. Then we encourage the translation of those words within a link to be consistent in two ways. On the one hand, when encoding sentences within a document we properly share context information of those words. On the other hand, we propose an auxiliary loss function to better constrain that their translation should be consistent. Experimental results on Chinese↔English and English→French translation tasks show that our approach not only achieves state-of-the-art performance in BLEU scores, but also greatly improves lexical consistency in translation.
Subfields: Artificial Intelligence, Natural Language Processing
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Elizabeth Clark
- Sebastian Gehrmann
- Thibault Sellam
- Yejin Choi
- Percy Liang
- Noah A. Smith
- Mohit Iyyer
- Jianfeng Gao
In Natural Language Processing
- Thibault Sellam
- Elizabeth Clark
- Sebastian Gehrmann
- Yejin Choi
- Yonatan Belinkov
- Tatsunori B. Hashimoto
- Greg Durrett
- Percy Liang
Citations in the corpus
- Repairing the Cracked Foundation: A Survey of Obstacles in Evaluation Practices for Generated Text (2022, background): “For example, Lyu et al. (2021) work on lexical consistency for documentlevel MT, which they first analyze and then derive a metric from.”