Federated Learning
By Qiang Yang, Yang Liu, Yong Cheng, Yan Kang, Tianjian Chen, Han Yu. 2019
1,040 citations recorded by the source corpus.
How is it possible to allow multiple data owners to collaboratively train and use a shared prediction model while keeping all the local training data private? Traditional machine learning approaches need to combine all data at one location, typically a data center, which may very well violate the laws on user privacy and data confidentiality. Today, many parts of the world demand that technology companies treat user data carefully according to user-privacy laws. The European Union’s General Data Protection Regulation (GDPR) is a prime example. In this book, we describe how federated machine learning addresses this problem with novel solutions combining distributed machine learning, cryptography and security, and incentive mechanism design based on economic principles and game theory. We explain different types of privacypreserving machine learning solutions and their technological backgrounds, and highlight some representative practical use cases.We show how federated learning can become the foundation of next-generation machine learning that caters to technological and societal needs for responsible AI development and application.
Subfields: Artificial Intelligence, Management Science and Operations Research, Federated & Distributed Learning
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Management Science and Operations Research
In Federated & Distributed Learning
Citations in the corpus
- FedML: A Research Library and Benchmark for Federated Machine Learning (2020, background): “Promising application domains include, but are not limited to, computer vision [77, 78], natural language processing [79, 80, 81, 82, 83], finance [74, 35, 84], transportation [85, 86, 87, 88, 89, 90, 91, 92, 93, 94], digital health [95, 96, 97, 98, 99, 100, 101], recommendation [102, 103, 104, 105,…”
- Federated Machine Learning (2019, neutral): “In [71], we have given a preliminary overview of the federated learning and federated transfer learning technique.”
- SecureBoost: A Lossless Federated Learning Framework (2019, background): “For example, financial institutes can leverage alternative data from a third party to enhance users’ and small and medium enterprises’ credit ratings [12].”
- Federated Learning for Keyword Spotting (2018, background): “There are for now very few real life experiments that we know of - except for Google’s key-board Gboard for Android [5] and more recently Mozilla’s URL suggestion bar [6].”
- Federated Learning: Challenges, Methods, and Future Directions (2019, methodology): “Federated learning methods have been deployed by major service providers [11, 124], and play a critical role in supporting privacy-sensitive applications where the training data are distributed at the edge [e.g., 5, 46, 51, 89, 105, 127, 139].”
- Adaptive Personalized Federated Learning (2020, methodology): “(2017); Almeida and Xavier (2018), where in addition to the optimization error, they have network constraints or peer-to-peer communication limitation Bellet et al. (2017); Zantedeschi et al. (2019). In general, as discussed by Kairouz et al. (2019), there are three significant categories of persona”
- Generalizing to Unseen Domains: A Survey on Domain Generalization (2021, background): “Another avenue for privacy protecting is decentralized learning, or federated learning [220, 221] where models do”
- Threats to Federated Learning: A Survey (2020, methodology): “FTL deals with scenarios in which FL participants have little overlap in both the sample space and the feature space [Yang et al. , 2019b].”
- Federated Learning for Open Banking (2021, background): “Different forms of incentives are possible, such as userdefined utility and money-based rewards, and have been well discussed in the literature [20,21,36,39].”
- Efficient Acceleration of Deep Learning Inference on Resource-Constrained Edge Devices: A Review (2023, background): “A shared model can learn collaboratively from local training data instead of requiring to accumulate the data to a central cloud server [360].”
- Vertical Federated Learning: Concepts, Advances, and Challenges (2022, background): “Federated Learning (FL) [1] is a novel machine learning paradigm where multiple parties collaboratively build machine learning models without centralizing their data.”
- A Sustainable Incentive Scheme for Federated Learning (2020, background): “Maximizing U satisfies Fairness criterion (1).”
- Survey on 6G Frontiers: Trends, Applications, Requirements, Technologies and Future Research (2021, background): “Recently, FL has emerged as a new AI concept that leverages on-device processing power and improves the user data privacy [210]–[212].”
- A Comprehensive Survey of Privacy-preserving Federated Learning (2021, methodology): “Client-Server Architecture [205].”
- Federated User Representation Learning (2019, methodology): “Transfer learning has also been proposed for personalization in FL [9], but it requires alternative freezing of local and global models, thus complicating the FL training process.”