A Context-Theoretic Framework for Compositionality in Distributional Semantics
By Daoud Clarke. 2011
68 citations recorded by the source corpus.
Formalizing “meaning as context” mathematically leads to a new, algebraic theory of meaning, in which composition is bilinear and associative. These properties are shared by other methods that have been proposed in the literature, including the tensor product, vector addition, point-wise multiplication, and matrix multiplication.Entailment can be represented by a vector lattice ordering, inspired by a strengthened form of the distributional hypothesis, and a degree of entailment is defined in the form of a conditional probability. Approaches to the task of recognizing textual entailment, including the use of subsequence matching, lexical entailment probability, and latent Dirichlet allocation, can be described within our framework.
Subfields: Artificial Intelligence, Computational Theory and Mathematics, Natural Language Processing, Representation & Self-Supervised Learning
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Phil Blunsom
- Yoav Goldberg
- Edward Grefenstette
- Mirella Lapata
- Mohit Bansal
- Luke S. Zettlemoyer
- Chris Dyer
- Kyunghyun Cho
In Computational Theory and Mathematics
- Edward Grefenstette
- Phil Blunsom
- Stephen Clark
- Peter D. Turney
- Nal Kalchbrenner
- Aurélie Herbelot
- Eva Maria Vecchi
In Natural Language Processing
- Phil Blunsom
- Edward Grefenstette
- Yoav Goldberg
- Mirella Lapata
- Stephen Clark
- Nal Kalchbrenner
- Kyunghyun Cho
- Karl Moritz Hermann
In Representation & Self-Supervised Learning
- Aurélie Herbelot
- Phil Blunsom
- Edward Grefenstette
- Stephen Clark
- Nal Kalchbrenner
- Eva Maria Vecchi
- Marco Baroni
- Peter D. Turney
Citations in the corpus
- A Convolutional Neural Network for Modelling Sentences (2014, background): “In some cases, composition is defined by algebraic operations over word meaning vectors to produce sentence meaning vectors (Erk and Padó, 2008; Mitchell and Lapata, 2008; Mitchell and Lapata, 2010; Turney, 2012; Erk, 2012; Clarke, 2012).”
- Building a shared world: mapping distributional to model-theoretic semantic spaces (2015, background): “…semantics in distributional terms (Coecke et al., 2011; Bernardi et al., 2013; Grefen-stette, 2013; Hermann et al., 2013; Baroni et al., 2014a; Clarke, 2012); b) the hybrid approaches, which try to keep the set-theoretic apparatus for function words and integrate distributions as content…”
- Distributional Semantics Beyond Words: Supervised Learning of Analogy and Paraphrase (2013, background): “Fourth, a single space integrates formal logic and vectors (Clarke, 2012).”
- Vector Space Models of Lexical Meaning (2015, background): “Some additional work includes Widdows (2008); Zanzotto et al. (2010); Clarke (2012) .”