Questions for Flat-Minima Optimization of Modern Neural Networks
By Jean Kaddour, Ricardo M. A. Silva, Matt J. Kusner. 2022
12 citations recorded by the source corpus.
Subfields: Optimization & Training
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Optimization & Training
- Ludwig Schmidt
- Mitchell Wortsman
- Ali Farhadi
- S. Gadre
- Gabriel Ilharco
- Raphael Gontijo-Lopes
- Yair Carmon
- Hongseok Namkoong
Citations in the corpus
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time (2022, background): “Most applications study models along the same optimization trajectory, e.g. (Ruppert, 1988; Polyak, 1990; Szegedy et al., 2016; Izmailov et al., 2018; Zhang et al., 2019; Kaddour et al., 2022; Junczys-Dowmunt et al., 2016).”