Bayesian Nonparametric Federated Learning of Neural Networks

By Mikhail Yurochkin, Mayank Agarwal, Soumya Ghosh, Kristjan H. Greenewald, Trong Nghia Hoang, Yasaman Khazaeni. 2019

912 citations recorded by the source corpus.

In federated learning problems, data is scattered across different servers and exchanging or pooling it is often impractical or prohibited. We develop a Bayesian nonparametric framework for federated learning with neural networks. Each data server is assumed to provide local neural network weights, which are modeled through our framework. We then develop an inference approach that allows us to synthesize a more expressive global network without additional supervision, data pooling and with as few as a single communication round. We then demonstrate the efficacy of our approach on federated learning problems simulated from two popular image classification datasets.

Subfields: Artificial Intelligence, Statistics and Probability, Probabilistic & Bayesian Methods, Federated & Distributed Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Qiang Yang
  2. Dacheng Tao
  3. Yang Liu
  4. Quoc V. Le
  5. Percy Liang
  6. Martin Jaggi
  7. Mohit Bansal
  8. Bingsheng He

In Statistics and Probability

  1. Bingsheng He
  2. Qinbin Li
  3. Virginia Smith
  4. Dimitris Papailiopoulos
  5. Jiayu Zhou
  6. Shashank Rajput
  7. Tianjian Chen
  8. Hangyu Zhu

In Probabilistic & Bayesian Methods

  1. Bingsheng He
  2. Qinbin Li
  3. Shashank Rajput
  4. Hangyu Zhu
  5. Jaehong Yoon
  6. Dawn Song
  7. Dacheng Tao
  8. Xiao Wang

In Federated & Distributed Learning

  1. Bingsheng He
  2. Qinbin Li
  3. Qiang Yang
  4. Chaoyang He
  5. Murali Annavaram
  6. Yang Liu
  7. Virginia Smith
  8. Tian Li

Citations in the corpus