Performance Issues and Error Analysis in an Open-Domain Question Answering System

By Dan I. Moldovan, Marius Pasca, Sanda M. Harabagiu, Mihai Surdeanu. 2002

359 citations recorded by the source corpus.

This paper presents an in-depth analysis of a state-of-the-art Question Answering system. Several scenarios are examined: (1) the performance of each module in a serial baseline system, (2) the impact of feedbacks and the insertion of a logic prover, and (3) the impact of various retrieval strategies and lexical resources. The main conclusion is that the overall performance depends on the depth of natural language processing resources and the tools used for answer finding.

Subfields: Artificial Intelligence, Question Answering & Reading Comprehension

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Percy Liang
  3. Luke S. Zettlemoyer
  4. Jianfeng Gao
  5. Graham Neubig
  6. Eric P. Xing
  7. Yejin Choi
  8. Yoshua Bengio

In Question Answering & Reading Comprehension

  1. Ming-Wei Chang
  2. William W. Cohen
  3. Wen-tau Yih
  4. Peter Clark
  5. Manzil Zaheer
  6. Graham Neubig
  7. Matthew Richardson
  8. Eric P. Xing

Citations in the corpus