RL-Based Federated Learning Framework Over Blockchain (RL-FL-BC)
Abstract
Federated learning (FL) paradigms aim to amalgamate diverse data properties stored locally at each user, while preserving data privacy through sharing users’ learning experiences and iteratively aggregating their local learning models into a global one. However, the majority of FL architectures with centralized cloud do not guarantee the trust in sharing users’ models, and hence, open the door for slowing and/or contaminating the global learning experience. In this paper, we propose a decentralized Blockchain (BC)-based framework and define a comprehensive protocol for exchanging local models, in order to guarantee users’ mutual trust while sharing their local learning experiences. We then propose a technique to optimize the global learning experience using Reinforcement Learning (RL), namely RL-FL-BC, to tackle the trade-off between information age of the learning parameters, data skewness (i.e., non-iid), and BC transaction cost (i.e., Ether price). We implement the proposed framework in a realistic containerized environment to facilitate the comparative study of the RL-FL-BC technique with baselines techniques. Our results show the efficacy of the BC-based protocol to facilitate the exchange of both the models’ and the optimization parameters to guarantee users’ mutual trust, while improving global learning performance compared to baselines techniques.
Collections
- Computer Science & Engineering [2288 items ]
Related items
Showing items related by title, author, creator and subject.
-
Machine Learning for Healthcare Wearable Devices: The Big Picture
Sabry, Farida; Eltaras, Tamer; Labda, Wadha; Alzoubi, Khawla; Malluhi, Qutaibah ( John Wiley and Sons Inc , 2022 , Article Review)Using artificial intelligence and machine learning techniques in healthcare applications has been actively researched over the last few years. It holds promising opportunities as it is used to track human activities and ... -
A cooperative Q-learning approach for online power allocation in femtocell networks
Saad H.; Mohamed A.; Elbatt T. ( IEEE , 2013 , Conference Paper)In this paper, we address the problem of distributed interference management of cognitive femtocells that share the same frequency range with macrocells using distributed multiagent Q-learning. We formulate and solve three ... -
A cooperative Q-learning approach for distributed resource allocation in multi-user femtocell networks
Saad H.; Mohamed A.; El Batt T. ( Institute of Electrical and Electronics Engineers Inc. , 2016 , Conference Paper)This paper studies distributed interference management for femtocells that share the same frequency band with macrocells. We propose a multi-agent learning technique based on distributed Q-learning, called subcarrier-based ...