Structural Deep Clustering Network

By Deyu Bo, Xiao Wang, Chuan Shi, Meiqi Zhu, Emiao Lu, Peng Cui. The Web Conference, 2020

684 citations recorded by the source corpus.

Clustering is a fundamental task in data analysis. Recently, deep clustering, which derives inspiration primarily from deep learning approaches, achieves state-of-the-art performance and has attracted considerable attention. Current deep clustering methods usually boost the clustering results by means of the powerful representation ability of deep learning, e.g., autoencoder, suggesting that learning an effective representation for clustering is a crucial requirement. The strength of deep clustering methods is to extract the useful representations from the data itself, rather than the structure of data, which receives scarce attention in representation learning. Motivated by the great success of Graph Convolutional Network (GCN) in encoding the graph structure, we propose a Structural Deep Clustering Network (SDCN) to integrate the structural information into deep clustering. Specifically, we design a delivery operator to transfer the representations learned by autoencoder to the corresponding GCN layer, and a dual self-supervised mechanism to unify these two different deep neural architectures and guide the update of the whole model. In this way, the multiple structures of data, from low-order to high-order, are naturally combined with the multiple representations learned by autoencoder. Furthermore, we theoretically analyze the delivery operator, i.e., with the delivery operator, GCN improves the autoencoder-specific representation as a high-order graph regularization constraint and autoencoder helps alleviate the over-smoothing problem in GCN. Through comprehensive experiments, we demonstrate that our propose model can consistently perform better over the state-of-the-art techniques.

Subfields: Artificial Intelligence

View Paper: https://www.semanticscholar.org/paper/fffbbc9d515ca6b5e9bc59cdded8c96a90c364d3

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

1. Philip S. Yu
2. Chuan Zhou
3. Jia Wu
4. Quan Z. Sheng
5. Shan Xue
6. Jian Yang
7. Emmanuel Müller
8. En Zhu

Citations in the corpus

• Graph Clustering with Graph Neural Networks (2020, methodology): “, 2019a), and SDCN (Bo et al., 2020) use k-means to initialize the model, prohibiting end-to-end learning.”
• A Comprehensive Survey on Community Detection With Deep Learning (2021, background): “For example, structural deep clustering network (SDCN) [125] includes a delivery operator that connects an AE and a GCN with the layers of a DNN in order to produce structure-aware representations.”
• Deep Graph Clustering via Dual Correlation Reduction (2021, methodology): “SDCN/SDCNQ (Bo et al. 2020), MVGRL (Hassani and Khasahmadi 2020) and DFCN (Tu et al.”