The Nonlinearity Coefficient - Predicting Overfitting in Deep Neural Networks

By George Philipp, Jaime G. Carbonell. 2018

11 citations recorded by the source corpus.

Subfields: Statistical Learning Theory

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Statistical Learning Theory

1. Greg Yang
2. Sam Schoenholz
3. Jeffrey Pennington
4. Jascha Narain Sohl-Dickstein
5. Hadi Salman
6. Boris Hanin
7. Il-Su Park
8. Piotr A. Sokól

Citations in the corpus

• A Mean Field Theory of Batch Normalization (2019, background): “We remark that Philipp & Carbonell (2018) has also empirically noted gradient explosion happens in deep batchnorm networks with various nonlinearities.”
• A Fine-Grained Spectral Perspective on Neural Networks (2019, background): “Closely related to the discussion of CK and NTK is the signal propagation literature, which tries to understand how to prevent pathological behaviors in randomly initialized neural networks when they are deep [48, 52, 71, 70, 23, 24, 14, 72, 44, 25, 47].”