Neural Machine Translation with Adequacy-Oriented Learning
By X. Kong, Zhaopeng Tu, Shuming Shi, Eduard H. Hovy, T. Zhang. 2018
27 citations recorded by the source corpus.
Although Neural Machine Translation (NMT) models have advanced state-of-the-art performance in machine translation, they face problems like the inadequate translation. We attribute this to that the standard Maximum Likelihood Estimation (MLE) cannot judge the real translation quality due to its several limitations. In this work, we propose an adequacyoriented learning mechanism for NMT by casting translation as a stochastic policy in Reinforcement Learning (RL), where the reward is estimated by explicitly measuring translation adequacy. Benefiting from the sequence-level training of RL strategy and a more accurate reward designed specifically for translation, our model outperforms multiple strong baselines, including (1) standard and coverage-augmented attention models with MLE-based training, and (2) advanced reinforcement and adversarial training strategies with rewards based on both word-level BLEU and character-level CHRF3. Quantitative and qualitative analyses on different language pairs and NMT architectures demonstrate the effectiveness and universality of the proposed approach.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Natural Language Processing, Machine Translation
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Computer Vision and Pattern Recognition
In Natural Language Processing
In Machine Translation
Citations in the corpus
- Survey of Hallucination in Natural Language Generation (2022, methodology): “Some works [74, 87, 108, 128, 174] adopt RL to solve the hallucination problem, which utilizes different rewards to optimize the model.”
- Neural Machine Translation: A Review (2019, background): “, 2018a) and tends to prefer fluency over adequacy (Kong et al., 2018).”