Probabilistic Latent Document Network Embedding

By Tuan M. V. Le, Hady W. Lauw. 2014

69 citations recorded by the source corpus.

A document network refers to a data type that can be represented as a graph of vertices, where each vertex is associated with a text document. Examples of such a data type include hyperlinked Web pages, academic publications with citations, and user profiles in social networks. Such data have very high-dimensional representations, in terms of text as well as network connectivity. In this paper, we study the problem of embedding, or finding a low-dimensional representation of a document network that "preserves" the data as much as possible. These embedded representations are useful for various applications driven by dimensionality reduction, such as visualization or feature selection. While previous works in embedding have mostly focused on either the textual aspect or the network aspect, we advocate a holistic approach by finding a unified low-rank representation for both aspects. Moreover, to lend semantic interpretability to the low-rank representation, we further propose to integrate topic modeling and embedding within a joint model. The gist is to join the various representations of a document (words, links, topics, and coordinates) within a generative model, and to estimate the hidden representations through MAP estimation. We validate our model on real-life document networks, showing that it outperforms comparable baselines comprehensively on objective evaluation metrics.

Subfields: Artificial Intelligence, Statistical and Nonlinear Physics

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Statistical and Nonlinear Physics

Citations in the corpus

A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications (2017, methodology): “Graph visualization generates visualizations of a graph on a low dimensional space [20], [23], [48], [55], [58], [73].”
Accelerated Attributed Network Embedding (2017, background): “Some efforts have been devoted to leveraging network structure and attribute information for seeking a low-rank latent representation [19, 30].”
A Survey on Network Embedding (2017, background): “Besides network structures, Yang et al. (Yang et al. 2015) propose TADW that takes the rich information (e.g., text) associated with nodes into account when they learn the low dimensional representations of nodes.”
Label Informed Attributed Network Embedding (2017, background): “Attributed networks [18, 28] are ubiquitous in a variety of real-world information systems, such as academic networks and health care systems.”