Deep learning in neural networks: An overview

By J. Urgen Schmidhuber. 2014

17,623 citations recorded by the source corpus.

In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarizes relevant work, much of it from the previous millennium. Shallow and Deep Learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of backpropagation), unsupervised learning, reinforcement learning & evolutionary computation, and indirect search for short programs encoding deep and large networks.

Subfields: Artificial Intelligence, Scaling & Learning Theory

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Sergey Levine
  3. Mohit Bansal
  4. Quoc V. Le
  5. Jianfeng Gao
  6. Percy Liang
  7. Ruslan Salakhutdinov
  8. Dacheng Tao

In Scaling & Learning Theory

  1. Behnam Neyshabur
  2. Andrew M. Saxe
  3. Surya Ganguli
  4. Madhu S. Advani
  5. Razvan Pascanu
  6. Zhenyu A. Liao
  7. Romain Couillet
  8. Philip M. Long

Citations in the corpus