Generating Phrasal and Sentential Paraphrases: A Survey of Data-Driven Methods
By Nitin Madnani, Bonnie J. Dorr. 2010
316 citations recorded by the source corpus.
The task of paraphrasing is inherently familiar to speakers of all languages. Moreover, the task of automatically generating or extracting semantic equivalences for the various units of language—words, phrases, and sentences—is an important part of natural language processing (NLP) and is being increasingly employed to improve the performance of several NLP applications. In this article, we attempt to conduct a comprehensive and application-independent survey of data-driven phrasal and sentential paraphrase generation methods, while also conveying an appreciation for the importance and potential use of paraphrases in the field of NLP research. Recent work done in manual and automatic construction of paraphrase corpora is also examined. We also discuss the strategies used for evaluating paraphrase generation techniques and briefly explore some future trends in paraphrase generation.
Subfields: Artificial Intelligence, Natural Language Processing, Natural Language Generation
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Mohit Bansal
- Luke S. Zettlemoyer
- Graham Neubig
- Jianfeng Gao
- Percy Liang
- Yejin Choi
- Kevin Gimpel
- John Wieting
In Natural Language Processing
- John Wieting
- Kevin Gimpel
- Mohit Bansal
- Luke S. Zettlemoyer
- Graham Neubig
- Yejin Choi
- Benjamin Van Durme
- Jianfeng Gao
In Natural Language Generation
- Mohit Iyyer
- Huan Sun
- Alex Morales
- Ruslan Salakhutdinov
- Yulia Tsvetkov
- Alan W. Black
- Kevin Gimpel
- Xifeng Yan
Citations in the corpus
- Adversarial Example Generation with Syntactically Controlled Paraphrase Networks (2018, methodology): “Paraphrase generation (Androutsopoulos and Malakasiotis, 2010; Madnani and Dorr, 2010) has been tackled using many different methods, including those based on hand-crafted rules (McKeown, 1983), synonym substitution (Bolshakov and Gelbukh, 2004), machine translation (Quirk et al.”
- Ask the Right Questions: Active Question Reformulation with Reinforcement Learning (2017, methodology): “Bilingual corpora and machine translation have been used to generate paraphrases by pivoting through a second language[Madnani and Dorr, 2010].”
- Paraphrasing Revisited with Neural Machine Translation (2017, background): “Paraphrasing can be broadly described as the task of using an alternative surface form to express the same semantic content (Madnani and Dorr, 2010).”
- Style Transfer Through Back-Translation (2018, methodology): “Our work is also closely-related to a problem of paraphrase generation (Madnani and Dorr, 2010; Dong et al., 2017), including methods relying on (phrase-based) back-translation (Ganitkevitch et al.”
- A Continuously Growing Dataset of Sentential Paraphrases (2017, background): “Researchers have shown benefits of using paraphrases in a wide range of applications (Madnani and Dorr, 2010), including question answering (Fader et al., 2013), semantic parsing (Berant and Liang, 2014), information extraction (Sekine, 2006; Zhang et al., 2015), machine translation (Mehdizadeh…”
- Obfuscating Gender in Social Media Writing (2016, background): “Our problem can be considered one of paraphrase generation (Madnani and Dorr, 2010) with the ob-jective of defeating a text classifier.”
- SemEval-2015 Task 1: Paraphrase and Semantic Similarity in Twitter (PIT) (2015, background): “The ability to identify paraphrases, i.e. alternative expressions of the same (or similar) meaning, and the degree of their semantic similarity has proven useful for a wide variety of natural language processing applications (Madnani and Dorr, 2010).”
- Data Augmentation Approaches in Natural Language Processing: A Survey (2021, background): “Paraphrasing-based Methods As common phenomena in natural language, paraphrases are alternative ways to convey the same information as the original form [37, 38].”
- ReNoun: Fact Extraction for Nominal Attributes (2014, background): “Hence, if we extract the verb form of attributes we would need to translate them into noun form, which would require us to solve the paraphrasing problem and introduce more sources of error (Madnani and Dorr, 2010).”
- TextBox: A Unified, Modularized, and Extensible Framework for Text Generation (2021, background): “…because of incredible performance of deep learning models, many classic tasks have achieved rapid progress, such as machine translation (Vaswani et al., 2017a), dialogue systems (Li et al., 2016), text summarization (See et al., 2017), text paraphrasing (Madnani and Dorr, 2010), and more.”
- Synthetic review spamming and defense (2013, methodology): “4, to pass sentence-level text reuse detectors, one could further use paraphrasing techniques [17, 8].”
- Large-Scale, Diverse, Paraphrastic Bitexts via Sampling and Clustering (2019, background): “For a more comprehensive survey on data-driven approaches to paraphrasing, please refer to Madnani and Dorr (2010).”