AdaDelay: Delay Adaptive Distributed Stochastic Optimization

By Suvrit Sra, Adams Wei Yu, Mu Li, Alex Smola. 2016

45 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Blake E. Woodworth
2. Jialei Wang
3. Nati Srebro
4. Wotao Yin
5. Robert Hannah
6. Jakub Konecný
7. Jason D. Lee
8. Sebastian U. Stich

Citations in the corpus

• Graph Oracle Models, Lower Bounds, and Gaps for Parallel Stochastic Optimization (2018, background): “when multiple processors or machines are working asynchronously, reading iterates, taking some time to perform the oracle accesses and computation, then communicating the results back (or updating the iterate accordingly) [1, 6, 16, 18, 24].”
• On Unbounded Delays in Asynchronous Parallel Fixed-Point Algorithms (2016, background): “Theorem 2 features a step size that adapts to current delay conditions, once again invariant in k, which is cited as a key advantage of [20].”