Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks
By Jin Huang, Wayne Xin Zhao, Hongjian Dou, Ji-rong Wen, Edward Y. Chang. 2018
541 citations recorded by the source corpus.
With the revival of neural networks, many studies try to adapt powerful sequential neural models, ıe Recurrent Neural Networks (RNN), to sequential recommendation. RNN-based networks encode historical interaction records into a hidden state vector. Although the state vector is able to encode sequential dependency, it still has limited representation power in capturing complicated user preference. It is difficult to capture fine-grained user preference from the interaction sequence. Furthermore, the latent vector representation is usually hard to understand and explain. To address these issues, in this paper, we propose a novel knowledge enhanced sequential recommender. Our model integrates the RNN-based networks with Key-Value Memory Network (KV-MN). We further incorporate knowledge base (KB) information to enhance the semantic representation of KV-MN. RNN-based models are good at capturing sequential user preference, while knowledge-enhanced KV-MNs are good at capturing attribute-level user preference. By using a hybrid of RNNs and KV-MNs, it is expected to be endowed with both benefits from these two components. The sequential preference representation together with the attribute-level preference representation are combined as the final representation of user preference. With the incorporation of KB information, our model is also highly interpretable. To our knowledge, it is the first time that sequential recommender is integrated with external memories by leveraging large-scale KB information.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Information Systems, Recommender Systems, Knowledge Graphs & Representation
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Computer Vision and Pattern Recognition
In Information Systems
In Recommender Systems
In Knowledge Graphs & Representation
Citations in the corpus
- Knowledge Graph Convolutional Networks for Recommender Systems (2019, methodology): “One feasible way is to preprocess the KG by knowledge graph embedding (KGE) methods [20], which map entities and relations to low-dimensional representation vectors [9, 19, 23].”
- Explainable Recommendation: A Survey and New Perspectives (2018, background): “Huang et al. [2018] leveraged knowledge bases for recommendation with better explainability in a sequential recommendation setting.”
- Filter-enhanced MLP is All You Need for Sequential Recommendation (2022, methodology): “,memory network [9, 20] and self-attention mechanism [26, 27]) to enhance the modeling capacity for effectively capturing dynamic user preference.”
- Hierarchical Gating Networks for Sequential Recommendation (2019, background): “In [1, 16], memory networks [33] are adopted to memorize the important items that will play a role in predicting future user actions.”
- Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences (2019, background): “In this case, although we have accurately captured the user’s preference on movies, we may still fail to recommend Death Becomes Her (which is also of interest to the user), due to the missing relation in the KG (cf. the red dashed line).”
- Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion (2020, background): “Especially, knowledge graphs have been widely adopted to enhance the recommendation performance and explainability [10, 31, 37].”
- A Survey on Accuracy-Oriented Neural Recommendation: From Collaborative Filtering to Information-Rich Recommendation (2021, unknown): “based models [132], [169], [178], [179], and GNN-based approaches [97], [128], [141], [170], [180], [181], [182], [183], [184], [185], [186], [187].”
- Personalized Fashion Recommendation with Visual Explanations based on Multimodal Attention Network: Towards Visually Explainable Recommendation (2019, methodology): “In addition to user review information, recent years have also witnessed the emergence of explainable recommendation with knowledge graph [1, 4, 16, 38, 41].”
- BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer (2019, methodology): “[19] employ Memory Network to improve sequential recommendation.”
- A Survey on Knowledge Graph-Based Recommender Systems (2020, methodology): “[2], [14], [44], [45], [66], [70], [81], [83], [87], [92], [93], [95], [96] MovieLens-20M [44], [86], [88], [89], [91] museums, parks, cities, etc.) to users based on their historical check-in data.”
- Reinforcement Knowledge Graph Reasoning for Explainable Recommendation (2019, methodology): “[10] employed memory networks over knowledge graph entity embeddings for recommendation.”
- Contrastive Learning for Sequential Recommendation (2022, background): “Chen et al. [5] and Huang et al. [22] leverage the memory-augmented neural network to store and update useful information explicitly.”
- KGAT: Knowledge Graph Attention Network for Recommendation (2019, background): “Several recent efforts have attempted to leverage the CKG structure for recommendation, which can be roughly categorized into two types, path-based [14, 25, 29, 33, 37, 39] and regularizationbased [5, 15, 33, 38]:”
- Learning Intents behind Interactions with Knowledge Graph for Recommendation (2021, background): “GNN-based Methods [17, 38, 39, 41, 47] are founded upon the information aggregation mechanism of graph neural networks (GNNs) [13, 14, 19, 34, 42].”
- S3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization (2020, methodology): “] firstly introduced Gated Recurrent Units (GRU) to the session-based recommendation and a surge of following variants modified this model by introducing pair-wise loss functions [4], memory networks [6, 7], hierarchical structures [17], copy mechanism [18] and reinforcement learning [27], etc. Ther”
- RecBole: Towards a Unified, Comprehensive and Efficient Framework for Recommendation Algorithms (2020, unknown): “KSR [25] SIGIR 2018 LastFM, MovieLens, Amazon”
- Explainable Interaction-driven User Modeling over Knowledge Graph for Sequential Recommendation (2019, methodology): “KGE-based methods usually combines content representations of the items themselves with knowledge-aware embeddings to generate a better representation for item [11, 23, 29].”