A cooperative Q-learning approach for distributed resource allocation in multi-user femtocell networks
Abstract
This paper studies distributed interference management for femtocells that share the same frequency band with macrocells. We propose a multi-agent learning technique based on distributed Q-learning, called subcarrier-based distributed resource allocation using Q-learning (SBDRA-Q). SBDRA-Q operates under three different learning paradigms: Independent (IL), Cooperative (CL) and Weighted Cooperative (WCL). In the IL paradigm, all femtocells learn independently from each other. In both, CL and WCL, femtocells share partial information during the learning process in order to enhance their performance. The results show that WCL outperforms both CL and IL in terms of aggregate femtocell capacity, while slightly affecting fairness. Also, the results show that CL and WCL are more robust, when compared to IL, to new femtocells being deployed during the learning process. Finally, we show SBDRA-Q achieves higher aggregate femtocell capacity under the three learning paradigms when compared to a power allocation scheme (SBDPC-Q) that was proposed in the literature. 2014 IEEE.
Collections
- Computer Science & Engineering [2382 items ]
Related items
Showing items related by title, author, creator and subject.
-
Machine Learning for Healthcare Wearable Devices: The Big Picture
Sabry, Farida; Eltaras, Tamer; Labda, Wadha; Alzoubi, Khawla; Malluhi, Qutaibah ( John Wiley and Sons Inc , 2022 , Article Review)Using artificial intelligence and machine learning techniques in healthcare applications has been actively researched over the last few years. It holds promising opportunities as it is used to track human activities and ... -
A cooperative Q-learning approach for online power allocation in femtocell networks
Saad H.; Mohamed A.; Elbatt T. ( IEEE , 2013 , Conference Paper)In this paper, we address the problem of distributed interference management of cognitive femtocells that share the same frequency range with macrocells using distributed multiagent Q-learning. We formulate and solve three ... -
Osseointegration Pharmacology: A Systematic Mapping Using Artificial Intelligence
Mahri M.; Shen N.; Berrizbeitia F.; Rodan R.; Daer A.; Faigan M.; Taqi D.; Wu K.Y.; Ahmadi M.; Ducret M.; Emami E.; Tamimi F.... more authors ... less authors ( Acta Materialia Inc , 2021 , Article)Clinical performance of osseointegrated implants could be compromised by the medications taken by patients. The effect of a specific medication on osseointegration can be easily investigated using traditional systematic ...