Bayesian Active Learning for Classification and Preference Learning

By Neil Houlsby, Ferenc Huszár, Zoubin Ghahramani, Máté Lengyel. 2011

1,125 citations recorded by the source corpus.

Information theoretic active learning has been widely studied for probabilistic models. For simple regression an optimal myopic policy is easily tractable. However, for other tasks and with more complex models, such as classication with nonparametric models, the optimal solution is harder to compute. Current approaches make approximations to achieve tractability. We propose an approach that expresses information gain in terms of predictive entropies, and apply this method to the Gaussian Process Classier (GPC). Our approach makes minimal approximations to the full information theoretic objective. Our experimental performance compares favourably to many popular active learning algorithms, and has equal or lower computational complexity. We compare well to decision theoretic approaches also, which are privy to more information and require much more computational time. Secondly, by developing further a reformulation of binary preference learning to a classication problem, we extend our algorithm to Gaussian Process preference learning.

Subfields: Artificial Intelligence, Probabilistic & Bayesian Methods, Meta & Continual Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Sergey Levine
  2. Yoshua Bengio
  3. Mohit Bansal
  4. Jianfeng Gao
  5. Ruslan Salakhutdinov
  6. Quoc V. Le
  7. Trevor Darrell
  8. Percy Liang

In Probabilistic & Bayesian Methods

  1. Yarin Gal
  2. Zoubin Ghahramani
  3. Richard E. Turner
  4. José Miguel Hernández-Lobato
  5. Max Welling
  6. Yee Whye Teh
  7. David M. Blei
  8. Thang D. Bui

In Meta & Continual Learning

  1. Yarin Gal
  2. Yee Whye Teh
  3. Richard E. Turner
  4. José Miguel Hernández-Lobato
  5. Richard S. Zemel
  6. Dustin Tran
  7. Michael A. Osborne
  8. Abhinav Kumar Gupta

Citations in the corpus