Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks

By Stefano Savazzi, Monica Nicoli, Vittorio Rampa. IEEE Internet of Things Journal, 2019

368 citations recorded by the source corpus.

Federated learning (FL) is emerging as a new paradigm to train machine learning (ML) models in distributed systems. Rather than sharing and disclosing the training data set with the server, the model parameters (e.g., neural networks’ weights and biases) are optimized collectively by large populations of interconnected devices, acting as local learners. FL can be applied to power-constrained Internet of Things (IoT) devices with slow and sporadic connections. In addition, it does not need data to be exported to third parties, preserving privacy. Despite these benefits, a main limit of existing approaches is the centralized optimization which relies on a server for aggregation and fusion of local parameters; this has the drawback of a single point of failure and scaling issues for increasing network size. This article proposes a fully distributed (or serverless) learning approach: the proposed FL algorithms leverage the cooperation of devices that perform data operations inside the network by iterating local computations and mutual interactions via consensus-based methods. The approach lays the groundwork for integration of FL within 5G and beyond networks characterized by decentralized connectivity and computing, with intelligence distributed over the end devices. The proposed methodology is verified by the experimental data sets collected inside an Industrial IoT (IIoT) environment.

Subfields: Artificial Intelligence, Computer Networks and Communications

View Paper: https://www.semanticscholar.org/paper/0d7e26c623068f7119878f12f5ee1a49b20b9c9d

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

In Computer Networks and Communications

Citations in the corpus

Federated Learning for Vehicular Internet of Things: Recent Advances and Open Issues (2020, background): “[67] propose a server-less variant of FL for massive IoT networks.”
Federated Learning for Internet of Things: A Comprehensive Survey (2021, background): “munication to achieve a consensus on the global update [36].”
Edge Artificial Intelligence for 6G: Vision, Enabling Technologies, and Applications (2021, background): “In this scenario, the local model updates need to be fast and reliably aggregated within neighbors via vehicle-to-vehicle communications [181], or to the roadside units via vehicle-to-infrastructure communication.”
Decentralized Federated Learning: A Survey and Perspective (2023, background): “DFL has received extensive attention as an emerging framework [55], [56], [57], [58], [59], [60].”