Natural Language Processing with Commonsense Knowledge: A Survey
By Yubo Xie, Zonghui Liu, Zongyang Ma, Fan Meng, Yan Xiao, Fahui Miao, Pearl Huan Z. Pu. 2021
8 citations recorded by the source corpus.
Commonsense knowledge is essential for advancing natural language processing (NLP) by enabling models to engage in human-like reasoning, which requires a deeper understanding of context and often involves making inferences based on implicit external knowledge. This paper explores the integration of commonsense knowledge into various NLP tasks. We begin by reviewing prominent commonsense knowledge bases and then discuss the benchmarks used to evaluate the commonsense reasoning capabilities of NLP models, particularly language models. Furthermore, we highlight key methodologies for incorporating commonsense knowledge and their applications across different NLP tasks. The paper also examines the challenges and emerging trends in enhancing NLP systems with commonsense reasoning. All literature referenced in this survey can be accessed via our GitHub repository: https://github.com/yuboxie/awesome-commonsense.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Natural Language Processing
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Sebastian Riedel
- Wen-tau Yih
- Patrick Lewis
- Fabio Petroni
- Hannaneh Hajishirzi
- Luke S. Zettlemoyer
- Gautier Izacard
- Danqi Chen
In Computer Vision and Pattern Recognition
- Sebastian Riedel
- Patrick Lewis
- Wen-tau Yih
- Fabio Petroni
- Gautier Izacard
- Hannaneh Hajishirzi
- Aleksandra Piktus
- Edouard Grave
In Natural Language Processing
- Sebastian Riedel
- Patrick Lewis
- Fabio Petroni
- Wen-tau Yih
- Gautier Izacard
- Hannaneh Hajishirzi
- Edouard Grave
- Luke S. Zettlemoyer
Citations in the corpus
- The Web Is Your Oyster - Knowledge-Intensive NLP against a Very Large Web Corpus (2021, background): “Unsurprisingly, Wikipedia has also never gained much traction in common sense NLP. Contrary to the factual knowledge, common sense is believed to be universally accepted by humans while stated more implicitly (Xie and Pu, 2021).”