Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge

By Takayuki Nishio, Ryo Yonetani. 2018

1,773 citations recorded by the source corpus.

We envision a mobile edge computing (MEC) framework for machine learning (ML) technologies, which leverages distributed client data and computation resources for training high-performance ML models while preserving client privacy. Toward this future goal, this work aims to extend Federated Learning (FL), a decentralized learning framework that enables privacy-preserving training of models, to work with heterogeneous clients in a practical cellular network. The FL protocol iteratively asks random clients to download a trainable model from a server, update it with own data, and upload the updated model to the server, while asking the server to aggregate multiple client updates to further improve the model. While clients in this protocol are free from disclosing own private data, the overall training process can become inefficient when some clients are with limited computational resources (i.e., requiring longer update time) or under poor wireless channel conditions (longer upload time). Our new FL protocol, which we refer to as FedCS, mitigates this problem and performs FL efficiently while actively managing clients based on their resource conditions. Specifically, FedCS solves a client selection problem with resource constraints, which allows the server to aggregate as many client updates as possible and to accelerate performance improvement in ML models. We conducted an experimental evaluation using publicly-available large-scale image datasets to train deep neural networks on MEC environment simulations. The experimental results show that FedCS is able to complete its training process in a significantly shorter time compared to the original FL protocol.

Subfields: Artificial Intelligence, Electrical and Electronic Engineering, Federated & Distributed Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Medhi Bennis
  2. Peter Richtárik
  3. Jakub Konecný
  4. H. Vincent Poor
  5. Qiang Yang
  6. Jihong Park
  7. Dusist Niyato
  8. Virginia Smith

In Electrical and Electronic Engineering

  1. Medhi Bennis
  2. Merouane Debbah
  3. H. Vincent Poor
  4. Jihong Park
  5. Rui Zhang
  6. Walid Saad
  7. Dusist Niyato
  8. Khaled Ben Letaief

In Federated & Distributed Learning

  1. Jakub Konecný
  2. Peter Richtárik
  3. H. Vincent Poor
  4. Virginia Smith
  5. Medhi Bennis
  6. Qiang Yang
  7. Jianyu Wang
  8. Gauri Joshi

Citations in the corpus