Generalization of Two-layer Neural Networks: An Asymptotic Viewpoint

By Jimmy Ba, Murat A. Erdogdu, Taiji Suzuki, Denny Wu, Tianzong Zhang. 2020

78 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Keyulu Xu
2. Stefanie Sabrina Jegelka
3. Jingling Li
4. Simon Shaolei Du
5. Mozhi Zhang
6. Ken-ichi Kawarabayashi
7. Matthias Fey
8. Sanjeev Arora

Citations in the corpus

• How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks (2020, background): “Recent works also show that in high-dimensional settings of the NTK regime, MLP is asymptotically at most a linear predictor in certain scaling limits (Ba et al., 2020; Ghorbani et al., 2019).”