On-line backpropagation in two-layered neural networks

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Continual Learning in the Teacher-Student Setup: Impact of Task Similarity (2021, methodology): “Parameters: M = 2 , K = 1 , V = 1 . classical work on standard supervised learning by Saad & Solla (1995a); Riegler & Biehl (1995).”
Dynamics of stochastic gradient descent for two-layer neural networks in the teacher–student setup (2019, unknown): “Our main contributions are as follows: (i) The dynamics of SGD (online) learning by two-layer neural networks in the teacher-student setup was studied in a series of classic papers [41, 42, 43, 44, 45] from the statistical physics community, leading to a heuristic derivation of a set of coupled ordi”
Dynamics of Learning Near Singularities in Layered Networks (2008, unknown): “A statistical-physical approach has clarified that this phenomenon arises from symmetry (see, e.g., Riegler & Biehl, 1995; Saad & Solla, 1995a, 1995b; Biehl, Riegler, & W¨ ohler, 1996; Inoue, Park, & Okada, 2003, 2004; Park, Inoue, & Okada, 2003, 2005; see also Biehl & Schwarze, 1995; Biehl & Cati”