Optimal bucket algorithms for large MPI collectives on torus interconnects

By Nikhil Jain, Y. Sabharwal. 2010

39 citations recorded by the source corpus.

Subfields: Computer Networks and Communications, Hardware and Architecture, ML Systems & Hardware

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Networks and Communications

1. Penporn Koanantakool

In Hardware and Architecture

1. Noam Shazeer
2. Blake A. Hechtman
3. Penporn Koanantakool
4. HyoukJoong Lee
5. Cliff Young
6. Yi Tay
7. Donald Metzler
8. Dara Bahri

In ML Systems & Hardware

1. Noam Shazeer
2. Blake A. Hechtman
3. HyoukJoong Lee
4. Ashish Vaswani

Citations in the corpus

• Mesh-TensorFlow: Deep Learning for Supercomputers (2018, background): “Assuming that the mesh has physical links between all pairs of logically adjacent processors, each Allreduce operations can be done in time proportional to the size of one slice divided by the per-link network bandwidth [5].”