PLink: Discovering and Exploiting Locality for Accelerated Distributed Training on the public Cloud

By Liang Luo, Peter West, Arvind Krishnamurthy, Luis Ceze, Jacob Nelson. 2020

57 citations recorded by the source corpus.

Subfields: Optimization & Training

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Optimization & Training

1. Chien-chin Huang
2. Min Xu
3. Myle Ott
4. Liangchen Luo
5. Sam Shleifer

Citations in the corpus

• PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel (2023, background): “Specifically, datacenters typically adopt a fat-tree network topology [15] with over-subscription, leading to abundant locality to exploit and a well-motivated reason to reduce cross-host traffic [16].”