IBM Federated Learning: an Enterprise Framework White Paper V0.1
By Heiko Ludwig, Nathalie Baracaldo, Gegi Thomas, Yi Zhou, Ali Anwar, Shashank Rajamoni, Yuya Jeremy Ong, Jayaram Radhakrishnan, Ashish Verma, Mathieu Sinn and 14 more. 2020
198 citations recorded by the source corpus.
Federated Learning (FL) is an approach to conduct machine learning without centralizing training data in a single place, for reasons of privacy, confidentiality or data volume. However, solving federated machine learning problems raises issues above and beyond those of centralized machine learning. These issues include setting up communication infrastructure between parties, coordinating the learning process, integrating party results, understanding the characteristics of the training data sets of different participating parties, handling data heterogeneity, and operating with the absence of a verification data set. IBM Federated Learning provides infrastructure and coordination for federated learning. Data scientists can design and run federated learning jobs based on existing, centralized machine learning models and can provide high-level instructions on how to run the federation. The framework applies to both Deep Neural Networks as well as ``traditional'' approaches for the most common machine learning libraries. {\proj} enables data scientists to expand their scope from centralized to federated machine learning, minimizing the learning curve at the outset while also providing the flexibility to deploy to different compute environments and design custom fusion algorithms.
Subfields: Artificial Intelligence, Federated & Distributed Learning, ML Systems & Hardware
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
In Federated & Distributed Learning
In ML Systems & Hardware
Citations in the corpus
- FedScale: Benchmarking Model and System Performance of Federated Learning (2021, methodology): “It enables model training and evaluation on end-user data, while circumventing high cost and privacy risks in gathering the raw data from clients, with applications in diverse domains: for example, NVIDIA applies FL to create medical imaging AI [26]; Google runs federated training of NLP models in G”
- Papaya: Practical, Private, and Scalable Federated Learning (2021, unknown): “Ludwig et al., 2020; NVIDIA; WeBank).”
- FedScale: Benchmarking Model and System Performance of Federated Learning at Scale (2021, methodology): “It enables model training and evaluation on end-user data, while circumventing high cost and privacy risks in gathering the raw data from clients, with applications in diverse domains: for example, NVIDIA applies FL to create medical imaging AI [37]; Google runs federated training of NLP models in G”