Federated Learning over Wireless Networks: Optimization Model Design and Analysis

By Nguyen H. Tran, Wei Bao, Albert Y. Zomaya, Minh N. H. Nguyen, Choong Seon Hong. 2019

911 citations recorded by the source corpus.

There is an increasing interest in a new machine learning technique called Federated Learning, in which the model training is distributed over mobile user equipments (UEs), and each UE contributes to the learning model by independently computing the gradient based on its local training data. Federated Learning has several benefits of data privacy and potentially a large amount of UE participants with modern powerful processors and low-delay mobile-edge networks. While most of the existing work focused on designing learning algorithms with provable convergence time, other issues such as uncertainty of wireless channels and UEs with heterogeneous power constraints and local data size, are under-explored. These issues especially affect to various trade-offs: (i) between computation and communication latencies determined by learning accuracy level, and thus (ii) between the Federated Learning time and UE energy consumption. We fill this gap by formulating a Federated Learning over wireless network as an optimization problem FEDL that captures both trade-offs. Even though FEDL is non-convex, we exploit the problem structure to decompose and transform it to three convex sub-problems. We also obtain the globally optimal solution by charactering the closed-form solutions to all sub-problems, which give qualitative insights to problem design via the obtained optimal FEDL learning time, accuracy level, and UE energy cost. Our theoretical analysis is also illustrated by extensive numerical results.

Subfields: Artificial Intelligence, Electrical and Electronic Engineering, Federated & Distributed Learning

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Dusist Niyato
  2. H. Vincent Poor
  3. Khaled Ben Letaief
  4. Mingzhe Chen
  5. Yuanming Shi
  6. Walid Saad
  7. Medhi Bennis
  8. Ming Ding

In Electrical and Electronic Engineering

  1. H. Vincent Poor
  2. Khaled Ben Letaief
  3. Rui Zhang
  4. Walid Saad
  5. Mingzhe Chen
  6. Dusist Niyato
  7. Medhi Bennis
  8. Yuanming Shi

In Federated & Distributed Learning

  1. Mingzhe Chen
  2. Walid Saad
  3. H. Vincent Poor
  4. Medhi Bennis
  5. Khaled Ben Letaief
  6. Yuanming Shi
  7. Dusist Niyato
  8. Shuguang Cui

Citations in the corpus