Erroneous data generation for Grammatical Error Correction
By Shuyao Xu, Jiehao Zhang, Jin Chen, Long Qin. 2019
24 citations recorded by the source corpus.
It has been demonstrated that the utilization of a monolingual corpus in neural Grammatical Error Correction (GEC) systems can significantly improve the system performance. The previous state-of-the-art neural GEC system is an ensemble of four Transformer models pretrained on a large amount of Wikipedia Edits. The Singsound GEC system follows a similar approach but is equipped with a sophisticated erroneous data generating component. Our system achieved an F0:5 of 66.61 in the BEA 2019 Shared Task: Grammatical Error Correction. With our novel erroneous data generating component, the Singsound neural GEC system yielded an M2 of 63.2 on the CoNLL-2014 benchmark (8.4% relative improvement over the previous state-of-the-art system).
Subfields: Artificial Intelligence, Natural Language Processing
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Varun Prashant Gangal
- Soroush Vosoughi
- Eduard H. Hovy
- Teruko Mitamura
- Jason Wei
- Steven Y. Feng
- Sarath Chandar
- Yuelin Wang
In Natural Language Processing
- Varun Prashant Gangal
- Eduard H. Hovy
- Teruko Mitamura
- Soroush Vosoughi
- Jason Wei
- Steven Y. Feng
- Sarath Chandar
- Yuelin Wang
Citations in the corpus
- A Survey of Data Augmentation Approaches for NLP (2021, methodology): “Yang et al. (2019) propose a DA method using distant supervision to improve BERT finetuning for opendomain QA.”
- A Comprehensive Survey of Grammatical Error Correction (2021, background): “Many Transformer-based GEC systems adopted pre-training on artificial parallel GEC data [15, 19, 51, 70, 74, 141, 152].”
- A Comprehensive Survey of Grammar Error Correction (2020, methodology): “Many Transformer based GEC systems adopted pre-training on artificial parallel GEC data [57], [56], [55], [99], [100].”