Speech Recognition and the Frequency of Recently Used Words: A Modified Markov Model for Natural Language
By Roland Kuhn. 1988
Speech recognition systems incorporate a language model which, at each stage of the recognition task, assigns a probability of occurrence to each word in the vocabulary. A class of Markov language models identified by Jelinek has achieved considerable success in this domain. A modification of the Markov approach, which assigns higher probabilities to recently used words, is proposed and tested against a pure Markov model. Parameter calculation and comparison of the two models both involve use of the LOB Corpus of tagged modern English.
Subfields: Speech & Audio
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Speech & Audio
- R. Rosenfeld
- Nicolas Usunier
- Armand Joulin
- Edouard Grave
- Joshua Goodman
- Moustapha Cissé
- Gabriel Synnaeve
- Andreas Stolcke
Citations in the corpus
- Unbounded cache model for online language modeling with open vocabulary (2017, methodology): “Our approach is inspired by the cache model of Khun [36] and can be seen as an extension of Grave et al. [22] to an unbounded memory structure tailored to deal with out-of-vocabulary and rare words.”
- Improving Neural Language Models with a Continuous Cache (2016, methodology): “Our model share some similarities with a model proposed by Kuhn (1988), called the cache model .”
- A bit of progress in language modeling (2001, background): “Caching models (Kuhn, 1988; Kuhn and De Mori, 1990; Kuhn and De Mori, 1992) make use of the observation that if you use a word, you are likely to use it again.”
- Adaptive Language Modeling Using Minimum Discriminant Estimation (1992, unknown): “The idea of using a window of the previous N words, called a cache, to estimate dynamic frequencies for a word was proposed in [5] for the case of a tri-part-ofspeech model and in [6] for a bigram model.”
- A maximum entropy approach to adaptive statistical language modelling (1996, background): “N -gramcaches were first reportedby [Kuhn 88]and[Kupiec 89].”
- Two decades of statistical language modeling: where do we go from here? (2000, background): “Cache LMs were first introduced by [59] and [60].”