A unified theory of adaptive stochastic gradient descent as Bayesian filtering

By Laurence Aitchison. 2018

4 citations recorded by the source corpus.

Subfields: Optimization & Training

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Optimization & Training

1. Frank Hutter
2. Ilya Loshchilov
3. Chris J. Maddison
4. Michael Auli
5. George E. Dahl
6. Zachary Nado
7. Quoc V. Le
8. Jaehoon Lee

Citations in the corpus

• On Empirical Comparisons of Optimizers for Deep Learning (2019, background): “Others do not even report the value of (cid:15) used (Balles and Hennig, 2017; Zhang and Mitliagkas, 2017; Keskar and Socher, 2017; Chen et al., 2018; Zhou et al., 2018; Aitchison, 2018; Reddi et al., 2019; Luo et al., 2019).”
• Decoupled Weight Decay Regularization (2017, methodology): “(Aitchison, 2018).”