A contextual-bandit approach to personalized news article recommendation

By Lihong Li, Wei Chu, J. Langford, Robert E. Schapire. 2010

3,422 citations recorded by the source corpus.

Personalized web services strive to adapt their services (advertisements, news articles, etc.) to individual users by making use of both content and user information. Despite a few recent advances, this problem remains challenging for at least two reasons. First, web service is featured with dynamically changing pools of content, rendering traditional collaborative filtering methods inapplicable. Second, the scale of most web services of practical interest calls for solutions that are both fast in learning and computation. In this work, we model personalized recommendation of news articles as a contextual bandit problem, a principled approach in which a learning algorithm sequentially selects articles to serve users based on contextual information about the users and articles, while simultaneously adapting its article-selection strategy based on user-click feedback to maximize total user clicks. The contributions of this work are three-fold. First, we propose a new, general contextual bandit algorithm that is computationally efficient and well motivated from learning theory. Second, we argue that any bandit algorithm can be reliably evaluated offline using previously recorded random traffic. Finally, using this offline evaluation method, we successfully applied our new algorithm to a Yahoo! Front Page Today Module dataset containing over 33 million events. Results showed a 12.5% click lift compared to a standard context-free bandit algorithm, and the advantage becomes even greater when data gets more scarce.

Subfields: Artificial Intelligence, Information Systems, Management Science and Operations Research, Recommender Systems

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Pieter Abbeel
  4. Mohit Bansal
  5. Jianfeng Gao
  6. Percy Liang
  7. Ruslan Salakhutdinov
  8. Quoc V. Le

In Information Systems

  1. Xiangnan He
  2. Xing Xie
  3. Xiang Wang
  4. Maarten de Rijke
  5. Tat-seng Chua
  6. Thorsten Joachims
  7. Lihong Li
  8. Nathan Kallus

In Management Science and Operations Research

  1. Lihong Li
  2. Sergey Levine
  3. Csaba Szepesvari
  4. Nathan Kallus
  5. Emma Brunskill
  6. R´emi Munos
  7. Nan Jiang
  8. Alekh Agarwal

In Recommender Systems

  1. Nathan Kallus
  2. Lihong Li
  3. Xiangnan He
  4. Charu C. Aggarwal
  5. Thorsten Joachims
  6. Qingyun Wu
  7. Hongning Wang
  8. Xing Xie

Citations in the corpus