Local Model Poisoning Attacks to Byzantine-Robust Federated Learning

By Minghong Fang, Xiaoyu Cao, Jinyuan Jia, Neil Zhenqiang Gong. USENIX Security Symposium, 2019

1,621 citations recorded by the source corpus.

In federated learning, multiple client devices jointly learn a machine learning model: each client device maintains a local model for its local training dataset, while a master device maintains a global model via aggregating the local models from the client devices. The machine learning community recently proposed several federated learning methods that were claimed to be robust against Byzantine failures (e.g., system failures, adversarial manipulations) of certain client devices. In this work, we perform the first systematic study on local model poisoning attacks to federated learning. We assume an attacker has compromised some client devices, and the attacker manipulates the local model parameters on the compromised client devices during the learning process such that the global model has a large testing error rate. We formulate our attacks as optimization problems and apply our attacks to four recent Byzantine-robust federated learning methods. Our empirical results on four real-world datasets show that our attacks can substantially increase the error rates of the models learnt by the federated learning methods that were claimed to be robust against Byzantine failures of some client devices. We generalize two defenses for data poisoning attacks to defend against our local model poisoning attacks. Our evaluation results show that one defense can effectively defend against our attacks in some cases, but the defenses are not effective enough in other cases, highlighting the need for new defenses against our local model poisoning attacks to federated learning.

Subfields: Artificial Intelligence, Federated & Distributed Learning, Privacy & Security

View Paper: https://arxiv.org/abs/1911.11815

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Lichao Sun
  2. Qiang Yang
  3. Philip S. Yu
  4. Lingjuan Lyu
  5. Neil Zhenqiang Gong
  6. Amir Salman Avestimehr
  7. Dusist Niyato
  8. Han Yu

In Federated & Distributed Learning

  1. Dusist Niyato
  2. Qiang Yang
  3. Amir Salman Avestimehr
  4. Lingjuan Lyu
  5. Bingsheng He
  6. Qinbin Li
  7. Virginia Smith
  8. Tian Li

In Privacy & Security

  1. Lingjuan Lyu
  2. Dusist Niyato
  3. Neil Zhenqiang Gong
  4. Basak Guler
  5. Amir Salman Avestimehr
  6. Jinhyun So
  7. Lichao Sun
  8. Philip S. Yu

Citations in the corpus