Head-Driven Statistical Models for Natural Language Parsing

By Michael Collins. 2003

2,083 citations recorded by the source corpus.

This article describes three statistical models for natural language parsing. The models extend methods from probabilistic context-free grammars to lexicalized grammars, leading to approaches in which a parse tree is represented as the sequence of decisions corresponding to a head-centered, top-down derivation of the tree. Independence assumptions then lead to parameters that encode the X-bar schema, subcategorization, ordering of complements, placement of adjuncts, bigram lexical dependencies, wh-movement, and preferences for close attachment. All of these preferences are expressed by probabilities conditioned on lexical heads. The models are evaluated on the Penn Wall Street Journal Treebank, showing that their accuracy is competitive with other models in the literature. To gain a better understanding of the models, we also give results on different constituent types, as well as a breakdown of precision/recall results in recovering various types of dependencies. We analyze various characteristics of the models through experiments on parsing accuracy, by collecting frequencies of various structures in the treebank, and through linguistically motivated examples. Finally, we compare the models to others that have been applied to parsing the treebank, aiming to give some explanation of the difference in performance of the various models.

Subfields: Artificial Intelligence, Natural Language Processing, Information Extraction

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Percy Liang
  3. Luke S. Zettlemoyer
  4. Noah A. Smith
  5. Christopher D. Manning
  6. Yoshua Bengio
  7. Jianfeng Gao
  8. Yoav Goldberg

In Natural Language Processing

  1. Christopher D. Manning
  2. Luke S. Zettlemoyer
  3. Noah A. Smith
  4. Percy Liang
  5. Mohit Bansal
  6. Mirella Lapata
  7. Yoav Goldberg
  8. Graham Neubig

In Information Extraction

  1. Daniel Klein
  2. Dan Roth
  3. Christopher D. Manning
  4. Wen-tau Yih
  5. Jason Aaron Edward Weston
  6. Vasin Punyakanok
  7. Ronan Collobert
  8. Dipanjan Das

Citations in the corpus