Neural network based language models for highly inflective languages
By Tomas Mikolov, J. Kopecký, Lukáš Burget, Ondrej Glembek, Jan Honza Cernocký. 2009
99 citations recorded by the source corpus.
Subfields: Artificial Intelligence, Natural Language Processing, Model Architectures
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Luke S. Zettlemoyer
- Graham Neubig
- Jason Aaron Edward Weston
- Mohit Bansal
- Jianfeng Gao
- Kyunghyun Cho
- Percy Liang
- Noah A. Smith
In Natural Language Processing
- Luke S. Zettlemoyer
- Jason Aaron Edward Weston
- Graham Neubig
- Kyunghyun Cho
- Mohit Bansal
- Jianfeng Gao
- Yoav Goldberg
- Yejin Choi
In Model Architectures
- Sanjeev Khudanpur
- Myle Ott
- Stephen Roller
- Jan Honza Cernocký
- Xi Victoria Lin
- Jamie Callan
- Mona T. Diab
- Anoop Deoras
Citations in the corpus
- OPT: Open Pre-trained Transformer Language Models (2022, background): “Auto-regressive language models (Mikolov et al., 2009) have seen the largest growth in model size, from 117M parameters (Radford et al.”
- Learning to Reweight Terms with Distributed Representations (2015, background): “In this section, we briefly introduce recent work on distributed representations learning from neural network language models and also defines the target term weights we use in our framework.”
- Empirical Evaluation and Combination of Advanced Language Modeling Techniques (2011, background): “Emami’s model was a state of the art model on this dataset, until we have recently shown that Recurrent neural network based language model (RNNLM) is performing better [5].”
- Extensions of recurrent neural network language model (2011, background): “Table 2 shows comparison of the feedforward [12], simple recurrent [4] and BPTT-trained recurrent neural network language models on two corpora.”