Progressive Layered Extraction (PLE): A Novel Multi-Task Learning (MTL) Model for Personalized Recommendations

By Hongyan Tang, Junning Liu, Ming Zhao, Xudong Gong. 2020

780 citations recorded by the source corpus.

Multi-task learning (MTL) has been successfully applied to many recommendation applications. However, MTL models often suffer from performance degeneration with negative transfer due to the complex and competing task correlation in real-world recommender systems. Moreover, through extensive experiments across SOTA MTL models, we have observed an interesting seesaw phenomenon that performance of one task is often improved by hurting the performance of some other tasks. To address these issues, we propose a Progressive Layered Extraction (PLE) model with a novel sharing structure design. PLE separates shared components and task-specific components explicitly and adopts a progressive routing mechanism to extract and separate deeper semantic knowledge gradually, improving efficiency of joint representation learning and information routing across tasks in a general setup. We apply PLE to both complicatedly correlated and normally correlated tasks, ranging from two-task cases to multi-task cases on a real-world Tencent video recommendation dataset with 1 billion samples, and results show that PLE outperforms state-of-the-art MTL models significantly under different task correlations and task-group size. Furthermore, online evaluation of PLE on a large-scale content recommendation platform at Tencent manifests 2.23% increase in view-count and 1.84% increase in watch time compared to SOTA MTL models, which is a significant improvement and demonstrates the effectiveness of PLE. Finally, extensive offline experiments on public benchmark datasets demonstrate that PLE can be applied to a variety of scenarios besides recommendations to eliminate the seesaw phenomenon. PLE now has been deployed to the online video recommender system in Tencent successfully.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Information Systems, Model Architectures, Recommender Systems

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Wayne Xin Zhao
  2. Ji-rong Wen
  3. Xiangnan He
  4. Yupeng Hou
  5. Yong Li
  6. Chen Gao
  7. Yiqun Liu
  8. Shaoping Ma

In Computer Vision and Pattern Recognition

  1. Wayne Xin Zhao
  2. Ji-rong Wen
  3. Yong Li
  4. Chen Gao
  5. Depeng Jin
  6. Yupeng Hou
  7. Yu Zheng
  8. Bolin Ding

In Information Systems

  1. Wayne Xin Zhao
  2. Xiangnan He
  3. Yupeng Hou
  4. Ji-rong Wen
  5. Yong Li
  6. Chen Gao
  7. Yiqun Liu
  8. Shaoping Ma

In Model Architectures

  1. Yupeng Hou
  2. Ji-rong Wen
  3. Yiqun Liu
  4. Yaliang Li
  5. Yifan Wang
  6. Wayne Xin Zhao
  7. Yong Li
  8. Chen Gao

In Recommender Systems

  1. Yong Li
  2. Chen Gao
  3. Wayne Xin Zhao
  4. Ji-rong Wen
  5. Jinghua Piao
  6. Yu Zheng
  7. Yupeng Hou
  8. Bolin Ding

Citations in the corpus