Distributed learning of deep neural network over multiple agents

By Otkrist Gupta, Ramesh Raskar. 2018

776 citations recorded by the source corpus.

In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of neural network-based systems, we propose a new technique to train deep neural networks over several data sources. Our method allows for deep neural networks to be trained using data from multiple entities in a distributed fashion. We evaluate our algorithm on existing datasets and show that it obtains performance which is similar to a regular neural network trained on a single machine. We further extend it to incorporate semi-supervised learning when training with few labeled samples, and analyze any security concerns that may arise. Our algorithm paves the way for distributed training of deep neural networks in data sensitive applications when raw data may not be shared directly.

Subfields: Artificial Intelligence, Radiology, Nuclear Medicine and Imaging, Federated & Distributed Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Qiang Yang
  2. Yang Liu
  3. Murali Annavaram
  4. Chaoyang He
  5. Amir Salman Avestimehr
  6. Praneeth Vepakomma
  7. Ramesh Raskar
  8. Medhi Bennis

In Radiology, Nuclear Medicine and Imaging

  1. Praneeth Vepakomma
  2. Chaoyang He
  3. Murali Annavaram
  4. Ramesh Raskar
  5. Tristan Swedish
  6. Abhimanyu Dubey
  7. Abhishek Singh
  8. Chandra Thapa

In Federated & Distributed Learning

  1. Qiang Yang
  2. Murali Annavaram
  3. Chaoyang He
  4. Yang Liu
  5. Praneeth Vepakomma
  6. Ramesh Raskar
  7. Amir Salman Avestimehr
  8. Jihong Park

Citations in the corpus