Improving Retrieval-Based Question Answering with Deep Inference Models
By George-Sebastian Pirtoaca, Traian Rebedea, Stefan Ruseti. 2018
11 citations recorded by the source corpus.
Question answering is one of the most important and difficult applications at the border of information retrieval and natural language processing, especially when we talk about complex questions which require some form of inference to determine the correct answer. In this paper, we present a two-step method that combines information retrieval techniques optimized for question answering with deep learning models for natural language inference in order to tackle the multiple-choice question answering problem. In the first stage, each question-answer pair is fed into an information retrieval engine to find relevant candidate contexts that serve as the underlying knowledge for the inference models. In the second stage, deep learning architectures are used to predict if a candidate answer can be inferred from the context extracted in the first stage. We deploy multiple deep learning architectures pre-trained on different datasets in order to capture semantic features and to enlarge the scope of the questions we can answer correctly. As it will be described, each dataset used for training the inference models has particular characteristics that can be exploited. In the end, all these solvers are combined in an ensemble model to predict the correct answer. This proposed two-step model outperforms the best retrieval-based solver by over 3% in absolute accuracy. Moreover, the model can answer both simple, factoid questions and more complex questions that require reasoning or inference.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Information Systems, Retrieval-Augmented Generation, Natural Language Processing
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Computer Vision and Pattern Recognition
In Information Systems
In Natural Language Processing
Citations in the corpus
- Improving Question Answering with External Knowledge (2019, background): “For each discovered and linked entity, its Wikipedia abstract is extracted and appended to the corresponding reference document of each (question, answer option) pair.”