Robust Aggregation for Federated Learning

By Krishna Pillutla, Sham M. Kakade, Zaïd Harchaoui. 2019

1,001 citations recorded by the source corpus.

We present a novel approach to federated learning that endows its aggregation process with greater robustness to potential poisoning of local data or model parameters of participating devices. The proposed approach, Robust Federated Aggregation (RFA), relies on the aggregation of updates using the geometric median, which can be computed efficiently using a Weiszfeld-type algorithm. RFA is agnostic to the level of corruption and aggregates model updates without revealing each device’s individual contribution. We establish the convergence of the robust federated learning algorithm for the stochastic learning of additive models with least squares. We also offer two variants of RFA: a faster one with one-step robust aggregation, and another one with on-device personalization. We present experimental results with additive models and deep networks for three tasks in computer vision and natural language processing. The experiments show that RFA is competitive with the classical aggregation when the level of corruption is low, while demonstrating greater robustness under high corruption.

Subfields: Artificial Intelligence, Federated & Distributed Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Martin Jaggi
  2. Qiang Yang
  3. Peter Richtárik
  4. Jakub Konecný
  5. Percy Liang
  6. Yang Liu
  7. Sebastian U. Stich
  8. Quoc V. Le

In Federated & Distributed Learning

  1. Qiang Yang
  2. Jianyu Wang
  3. Gauri Joshi
  4. Virginia Smith
  5. Martin Jaggi
  6. Chaoyang He
  7. Murali Annavaram
  8. Jakub Konecný

Citations in the corpus