Weighted AdaGrad with Unified Momentum

By Fangyu Zou, Li Shen, Zequn Jie, Ju Sun, Wei Liu. 2018

43 citations recorded by the source corpus.

Subfields: Optimization & Training

Citations in the corpus

• A Simple Convergence Proof of Adam and Adagrad (2020, unknown): “The coordinate-wise version of Adagrad was also tackled by Zou et al. (2019b), offering a convergence result for Adagrad with either heavy-ball or Nesterov style momentum.”