Random Forests

By Trevor J. Hastie, Leo Breiman, Robert Tibshirani, Jerome H. Friedman. 2001

119,944 citations recorded by the source corpus.

Random forests are a combination of tree predictors such that each tree depends on the values of a random vector sampled independently and with the same distribution for all trees in the forest. The generalization error for forests converges a.s. to a limit as the number of trees in the forest becomes large. The generalization error of a forest of tree classifiers depends on the strength of the individual trees in the forest and the correlation between them. Using a random selection of features to split each node yields error rates that compare favorably to Adaboost (Y. Freund & R. Schapire, Machine Learning: Proceedings of the Thirteenth International conference, ***, 148–156), but are more robust with respect to noise. Internal estimates monitor error, strength, and correlation and these are used to show the response to increasing the number of features used in the splitting. Internal estimates are also used to measure variable importance. These ideas are also applicable to regression.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Model Architectures

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Mohit Bansal
  3. Percy Liang
  4. Quoc V. Le
  5. Sergey Levine
  6. Jianfeng Gao
  7. Ruslan Salakhutdinov
  8. Trevor Darrell

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Ming-Hsuan Yang
  4. Xiaogang Wang
  5. Trevor Darrell
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Yi Yang

In Model Architectures

  1. Yoshua Bengio
  2. Quoc V. Le
  3. Ruslan Salakhutdinov
  4. Kaiming He
  5. Alan L. Yuille
  6. Ross B. Girshick
  7. Aaron C. Courville
  8. Kyunghyun Cho

Citations in the corpus