ZerO Initialization: Initializing Residual Networks with only Zeros and Ones
By Jiawei Zhao, Florian Schäfer, Anima Anandkumar. 2021
12 citations recorded by the source corpus.
Subfields: Model Architectures, Optimization & Training
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Model Architectures
In Optimization & Training
Citations in the corpus
- Adding Conditional Control to Text-to-Image Diffusion Models (2023, background): “Manipulating the initial convolution weights is also discussed in ProGAN [21] and StyleGAN [22], as well as Noise2Noise [33] and [65].”