Zico: Efficient GPU Memory Sharing for Concurrent DNN Training

By Gangmuk Lim, Jeongseob Ahn, Wencong Xiao, Youngjin Kwon, Myeongjae Jeon. 2021

63 citations recorded by the source corpus.

Subfields: Efficiency & Compression, Optimization & Training

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Efficiency & Compression

1. Yonghui Wu
2. Joseph Dean
3. Aakanksha Chowdhery
4. Ruoming Pang
5. Hyeontaek Lim
6. Quoc V. Le
7. Dacheng Tao
8. Mingxing Tan

In Optimization & Training

1. Michael Isard
2. Aakanksha Chowdhery
3. Ruoming Pang
4. Ryan Sepassi
5. Yonghui Wu
6. Joseph Dean
7. Hyeontaek Lim

Citations in the corpus

• Pathways: Asynchronous Distributed Dataflow for ML (2022, background): “Concurrent (time-multiplexed or overlapping) ML task execution (Gupta et al., 2018; Xiao et al., 2020; Bai et al., 2020; Yu and Chowd-hury, 2020; Wang et al., 2021; Lim et al., 2021) helps harvest idle resources within accelerators.”