SimplE Embedding for Link Prediction in Knowledge Graphs

By Seyed Mehran Kazemi, David Poole. Neural Information Processing Systems, 2018

857 citations recorded by the source corpus.

Knowledge graphs contain knowledge about the world and provide a structured representation of this knowledge. Current knowledge graphs contain only a small subset of what is true in the world. Link prediction approaches aim at predicting new links for a knowledge graph given the existing links among the entities. Tensor factorization approaches have proved promising for such link prediction problems. Proposed in 1927, Canonical Polyadic (CP) decomposition is among the first tensor factorization approaches. CP generally performs poorly for link prediction as it learns two independent embedding vectors for each entity, whereas they are really tied. We present a simple enhancement of CP (which we call SimplE) to allow the two embeddings of each entity to be learned dependently. The complexity of SimplE grows linearly with the size of embeddings. The embeddings learned through SimplE are interpretable, and certain types of background knowledge can be incorporated into these embeddings through weight tying. We prove SimplE is fully expressive and derive a bound on the size of its embeddings for full expressivity. We show empirically that, despite its simplicity, SimplE outperforms several state-of-the-art tensor factorization techniques. SimplE's code is available on GitHub at this https URL.

Subfields: Artificial Intelligence, Computational Mathematics

View Paper: https://www.semanticscholar.org/paper/70af3ee98c53441d9090119f7b76efb1b6d03edd

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Partha P. Talukdar
  2. Apoorv Saxena
  3. Yi Tay
  4. Zequn Sun
  5. Wei Hu
  6. Timothy M. Hospedales
  7. Yoshua Bengio
  8. Mohit Bansal

In Computational Mathematics

  1. Partha P. Talukdar
  2. Apoorv Saxena
  3. Ivana Balazevic
  4. Carl Allen
  5. Timothy M. Hospedales
  6. Nicolas Usunier
  7. Aditay Tripathi
  8. Timothée Lacroix

Citations in the corpus