Mathematical Foundations for a Compositional Distributional Model of Meaning

By Bob Coecke, Mehrnoosh Sadrzadeh, Stephen Clark. 2010

624 citations recorded by the source corpus.

We propose a mathematical framework for a unification of the distributional theory of meaning in terms of vector space models, and a compositional theory for grammatical types, for which we rely on the algebra of Pregroups, introduced by Lambek. This mathematical framework enables us to compute the meaning of a well-typed sentence from the meanings of its constituents. Concretely, the type reductions of Pregroups are `lifted' to morphisms in a category, a procedure that transforms meanings of constituents into a meaning of the (well-typed) whole. Importantly, meanings of whole sentences live in a single space, independent of the grammatical structure of the sentence. Hence the inner-product can be used to compare meanings of arbitrary sentences, as it is for comparing the meanings of words in the distributional model. The mathematical structure we employ admits a purely diagrammatic calculus which exposes how the information flows between the words in a sentence in order to make up the meaning of the whole sentence. A variation of our `categorical model' which involves constraining the scalars of the vector spaces to the semiring of Booleans results in a Montague-style Boolean-valued semantics.

Subfields: Artificial Intelligence, Computational Theory and Mathematics, Natural Language Processing, Computational Linguistics & Semantics

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Percy Liang
  3. Yoav Goldberg
  4. Luke S. Zettlemoyer
  5. Christopher D. Manning
  6. Jianfeng Gao
  7. Richard Socher
  8. Yoshua Bengio

In Computational Theory and Mathematics

  1. Edward Grefenstette
  2. Alessandro Lenci
  3. Phil Blunsom
  4. Karl Moritz Hermann
  5. Christopher Potts
  6. Marco Baroni
  7. Samuel R. Bowman
  8. Tamara Polajnar

In Natural Language Processing

  1. Mohit Bansal
  2. Phil Blunsom
  3. Samuel R. Bowman
  4. Yoav Goldberg
  5. Christopher D. Manning
  6. Richard Socher
  7. Kyunghyun Cho
  8. Graham Neubig

In Computational Linguistics & Semantics

  1. Alessandro Lenci
  2. Phil Blunsom
  3. Aurélie Herbelot
  4. Edward Grefenstette
  5. Jacob Andreas
  6. Marco Baroni
  7. Karl Moritz Hermann
  8. Laura Rimell

Citations in the corpus