GECToR – Grammatical Error Correction: Tag, Not Rewrite

By Kostiantyn Omelianchuk, Vitaliy Atrasevych, Artem Chernodub, Oleksandr Skurzhanskyi. 2020

393 citations recorded by the source corpus.

In this paper, we present a simple and efficient GEC sequence tagger using a Transformer encoder. Our system is pre-trained on synthetic data and then fine-tuned in two stages: first on errorful corpora, and second on a combination of errorful and error-free parallel corpora. We design custom token-level transformations to map input tokens to target corrections. Our best single-model/ensemble GEC tagger achieves an F_0.5 of 65.3/66.5 on CONLL-2014 (test) and F_0.5 of 72.4/73.6 on BEA-2019 (test). Its inference speed is up to 10 times as fast as a Transformer-based seq2seq GEC system.

Subfields: Artificial Intelligence, Natural Language Processing, Information Extraction

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Furu Wei
  2. Graham Neubig
  3. Tao Ge
  4. Xiaojun Wan
  5. Mohit Bansal
  6. Zhifang Sui
  7. Song-Chun Zhu
  8. Yonatan Belinkov

In Natural Language Processing

  1. Furu Wei
  2. Xiaojun Wan
  3. Graham Neubig
  4. Tao Ge
  5. Xin Sun
  6. Houfeng Wang
  7. Zhuowei Liu
  8. Heming Xia

In Information Extraction

  1. Bo Wu
  2. Xin Sun
  3. Xiaojun Wan
  4. Song-Chun Zhu
  5. Graham Neubig
  6. Shoubin Yu
  7. Furu Wei
  8. Tao Ge

Citations in the corpus