Bandit Algorithms in Information Retrieval

By D. Głowacka. 2019

75 citations recorded by the source corpus.

Bandit algorithms, named after casino slot machines sometimes known as “one-armed bandits”, fall into a broad category of stochastic scheduling problems. In the setting with multiple arms, each arm generates a reward with a given probability. The gambler’s aim is to find the arm producing the highest payoff and then continue playing in order to accumulate the maximum reward possible. However, having only a limited number of plays, the gambler is faced with a dilemma: should he play the arm currently known to produce the highest reward or should he keep on trying other arms in the hope of finding a better paying one? This problem formulation is easily applicable to many real-life scenarios, hence in recent years there has been an increased interest in developing bandit algorithms for a range of applications. In information retrieval and recommender systems, bandit algorithms, which are simple to implement and do not require any training data, have been particularly popular in online personalization, online ranker evaluation and search engine optimization. This survey provides a brief overview of bandit algorithms designed to tackle specific issues in information retrieval and recommendation and, where applicable, it describes how they were applied in practice. Dorota Głowacka (2019), “Bandit Algorithms in Information Retrieval”, Foundations and Trends © in Information Retrieval: Vol. 13, No. 4, pp 299–424. DOI: 10.1561/1500000067. Full text available at: http://dx.doi.org/10.1561/1500000067

Subfields: Artificial Intelligence, Management Science and Operations Research, Information Retrieval & Search, Reinforcement Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Management Science and Operations Research

In Information Retrieval & Search

In Reinforcement Learning

Citations in the corpus

Bandit Algorithms (2020, background): “A more in-depth discussion on ranking can be found in the recent book on bandits in information retrieval by Glowacka [2019], which discusses a number of practical considerations, like the cold-start problem.”