PREDICTIVE LEARNING VIA RULE ENSEMBLES

By Jerome H. Friedman, Bogdan E. Popescu. 2008

1,280 citations recorded by the source corpus.

General regression and classification models are constructed as linear combinations of simple rules derived from the data. Each rule consists of a conjunction of a small number of simple statements concerning the values of individual input variables. These rule ensembles are shown to produce predictive accuracy comparable to the best methods. However, their principal advantage lies in interpretation. Because of its simple form, each rule is easy to understand, as is its influence on individual predictions, selected subsets of predictions, or globally over the entire space of joint input variable values. Similarly, the degree of relevance of the respective input variables can be assessed globally, locally in different regions of the input space, or at individual prediction points. Techniques are presented for automatically identifying those variables that are involved in interactions with other variables, the strength and degree of those interactions, as well as the identities of the other variables with which they interact. Graphical representations are used to visualize both main and interaction effects.

Subfields: Artificial Intelligence, Statistics and Probability, Optimization & Training, Algorithms & Complexity

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Cynthia Rudin
  2. Qiang Yang
  3. Mohit Bansal
  4. Yoshua Bengio
  5. Bin Yu
  6. Marco F. Huber
  7. Percy Liang
  8. Jianfeng Gao

In Statistics and Probability

  1. Bin Yu
  2. Tong Zhang
  3. Peter Buhlmann
  4. Cynthia Rudin
  5. Cun-Hui Zhang
  6. Gérard Biau
  7. Nicolai Meinshausen
  8. Erwan Scornet

In Optimization & Training

  1. Peter Richtárik
  2. Tong Zhang
  3. Jakub Konecný
  4. Gérard Biau
  5. Zeyuan Allen-Zhu
  6. Francis R. Bach
  7. Nicolai Meinshausen
  8. Erwan Scornet

In Algorithms & Complexity

  1. Cynthia Rudin
  2. Kush R. Varshney
  3. Dmitry M. Malioutov
  4. Kuldeep S. Meel
  5. Ş. Ertekin
  6. Birol Yüceoglu
  7. Joung Taek Yoon
  8. Verónica Bolón-Canedo

Citations in the corpus