Communication trade-offs for Local-SGD with large step size

By Aymeric Dieuleveut, Kumar Kshitij Patel. 2019

44 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Peter Richtárik
2. Sebastian U. Stich
3. Ahmed Khaled
4. Blake E. Woodworth
5. Jakub Konecný
6. Sai Praneeth Karimireddy
7. H. Brendan McMahan
8. Kumar Kshitij Patel

Citations in the corpus

• Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization (2020, neutral): “[37] Aymeric Dieuleveut and Kumar Kshitij Patel.”
• Is Local SGD Better than Minibatch SGD? (2020, background): “Dieuleveut and Patel (2019) analyze local SGD on quadratic objectives and show a result analogous to our Theorem 1.”
• Tighter Theory for Local SGD on Identical and Heterogeneous Data (2019, methodology): “…Patel (2019) An analysis of Local SGD for identical data under strong convexity, Lipschitzness of ∇ f , uniformly bounded variance, and Lipschitzness of ∇ 2 f is given in (Dieuleveut and Patel, 2019), where they obtain a similar communication complexity to (Stich, 2019) without bounded gradients.”