My First Deep Learning System of 1991 + Deep Learning Timeline 1962-2013

By J. Urgen Schmidhuber. 2013

12 citations recorded by the source corpus.

Deep Learning has attracted significant attention in recent years. Here I present a brief overview of my first Deep Learner of 1991, and its historic context, with a timeline of Deep Learning highlights.

Subfields: Artificial Intelligence, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

1. J. Urgen Schmidhuber
2. David R Ha
3. Alex Graves
4. Sergey Levine
5. Yoshua Bengio
6. Quoc V. Le
7. Faustino J. Gomez
8. Mohit Bansal

In Signal Processing

1. J. Urgen Schmidhuber
2. Alex Graves
3. Yoshua Bengio
4. Hasim Sak
5. Franccoise Beaufays
6. Santiago Fernández
7. Zachary Chase Lipton
8. Jinyu Li

Citations in the corpus

• Deep learning in neural networks: An overview (2014, methodology): “1991: UL-based history compression through a deep stack of RNNs Aworking Very Deep Learner (Section 3) of 1991 (Schmidhuber, 1992b, 2013a) could perform credit assignment across hundreds of nonlinear operators or neural layers, by using unsupervised pretraining for a hierarchy of RNNs.”