Shallow Parsing with Conditional Random Fields

By Fei Sha, Fernando C Pereira. 2003

1,567 citations recorded by the source corpus.

Conditional random fields for sequence labeling offer advantages over both generative models like HMMs and classifiers applied at each sequence position. Among sequence labeling tasks in language processing, shallow parsing has received much attention, with the development of standard evaluation datasets and extensive comparison among methods. We show here how to train a conditional random field to achieve performance as good as any reported base noun-phrase chunking method on the CoNLL task, and better than any reported single model. Improved training methods based on modern optimization algorithms were critical in achieving these results. We present extensive comparisons between models and training methods that confirm and strengthen previous results on shallow parsing and training methods for maximum-entropy models.

Subfields: Artificial Intelligence, Natural Language Processing, Computational Linguistics & Semantics

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Percy Liang
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Luke S. Zettlemoyer
  6. Noah A. Smith
  7. Christopher D. Manning
  8. Quoc V. Le

In Natural Language Processing

  1. Christopher D. Manning
  2. Percy Liang
  3. Noah A. Smith
  4. Mohit Bansal
  5. Luke S. Zettlemoyer
  6. Mirella Lapata
  7. Graham Neubig
  8. Yoav Goldberg

In Computational Linguistics & Semantics

  1. Andrew McCallum
  2. Michael Collins
  3. Ivan Titov
  4. Phil Blunsom
  5. Trevor Cohn
  6. Ronan Collobert
  7. Mark W. Schmidt
  8. James Richard Curran

Citations in the corpus