Statistical mechanics of deep learning
By Yasaman Bahri, Jonathan Kadmon, Jeffrey Pennington, Sam Schoenholz, Jascha Narain Sohl-Dickstein, Surya Ganguli. 2024
234 citations recorded by the source corpus.
Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Statistical and Nonlinear Physics
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Karsten Kreis
- Arash Vahdat
- Ari S. Morcos
- Tim Dockhorn
- Surya Ganguli
- Robert Geirhos
- Shashank Shekhar
- Jean Kaddour
In Computer Vision and Pattern Recognition
- Arash Vahdat
- Karsten Kreis
- Tim Dockhorn
- Shashank Shekhar
- Robert Geirhos
- Surya Ganguli
- Ari S. Morcos
- Luc Van Gool
In Statistical and Nonlinear Physics
- Arash Vahdat
- Karsten Kreis
- Tim Dockhorn
- Surya Ganguli
- Ari S. Morcos
- Greg Yang
- Sam Schoenholz
- Jeffrey Pennington
Citations in the corpus
- Continual Learning in the Teacher-Student Setup: Impact of Task Similarity (2021, neutral): “…al., 2017; Tian, 2017; Du et al., 2018; Soltanolkotabi et al., 2018; Aubin et al., 2018; Saxe et al., 2018; Baity-Jesi et al., 2018; Goldt et al., 2019; Ghorbani et al., 2019; Yoshida & Okada, 2019; Ndirango & Lee, 2019; Gabri ´ e, 2020; Bahri et al., 2020; Zdeborov ´ a, 2020; Advani et al., 2020).”
- Beyond neural scaling laws: beating power law scaling via data pruning (2022, background): “[23] Yasaman Bahri, Jonathan Kadmon, Jeffrey Pennington, Sam S Schoenholz, Jascha SohlDickstein, and Surya Ganguli.”
- Score-Based Generative Modeling with Critically-Damped Langevin Diffusion (2021, methodology): “Learning a mapping between a simple, tractable and a complex distribution as in SGMs is inspired by annealed importance sampling (Neal, 2001) and the Jarzynski equality from non-equilibrium statistical mechanics (Jarzynski, 1997a;b; 2011; Bahri et al., 2020).”