Natural Language Processing (Almost) from Scratch

By Ronan Collobert, Jason Aaron Edward Weston, L. Eon Bottou, Michael Karlen, Koray Kavukcuoglu, Pavel P. Kuksa. 2011

7,931 citations recorded by the source corpus.

We propose a unified neural network architecture and learning algorithm that can be applied to various natural language processing tasks including part-of-speech tagging, chunking, named entity recognition, and semantic role labeling. This versatility is achieved by trying to avoid task-specific engineering and therefore disregarding a lot of prior knowledge. Instead of exploiting man-made input features carefully optimized for each task, our system learns internal representations on the basis of vast amounts of mostly unlabeled training data. This work is then used as a basis for building a freely available tagging system with good performance and minimal computational requirements.

Subfields: Artificial Intelligence, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Percy Liang
  4. Luke S. Zettlemoyer
  5. Yoshua Bengio
  6. Graham Neubig
  7. Kyunghyun Cho
  8. Quoc V. Le

In Natural Language Processing

  1. Mohit Bansal
  2. Graham Neubig
  3. Jianfeng Gao
  4. Luke S. Zettlemoyer
  5. Kyunghyun Cho
  6. Richard Socher
  7. Percy Liang
  8. Yejin Choi

Citations in the corpus