The Impact of Local Geometry and Batch Size on the Convergence and Divergence of Stochastic Gradient Descent

By Vivak Patel. 2017

6 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Yuanzhi Li
2. Zeyuan Allen-Zhu
3. Yang Yuan
4. Robert D. Kleinberg
5. Simon Shaolei Du
6. Jason D. Lee
7. Aleksandrs Slivkins
8. Sanjeev Arora

Citations in the corpus

• An Alternative View: When Does SGD Escape Local Minima? (2018, background): “There are also explanations for why small batch methods prefers flat minima while large batch methods are not, by investigating the canonical quadratic sums problem [25].”