A cooperative Q-learning approach for distributed resource allocation in multi-user femtocell networks
Abstract
This paper studies distributed interference management for femtocells that share the same frequency band with macrocells. We propose a multi-agent learning technique based on distributed Q-learning, called subcarrier-based distributed resource allocation using Q-learning (SBDRA-Q). SBDRA-Q operates under three different learning paradigms: Independent (IL), Cooperative (CL) and Weighted Cooperative (WCL). In the IL paradigm, all femtocells learn independently from each other. In both, CL and WCL, femtocells share partial information during the learning process in order to enhance their performance. The results show that WCL outperforms both CL and IL in terms of aggregate femtocell capacity, while slightly affecting fairness. Also, the results show that CL and WCL are more robust, when compared to IL, to new femtocells being deployed during the learning process. Finally, we show SBDRA-Q achieves higher aggregate femtocell capacity under the three learning paradigms when compared to a power allocation scheme (SBDPC-Q) that was proposed in the literature. 2014 IEEE.
Collections
- Computer Science & Engineering [2280 items ]
Related items
Showing items related by title, author, creator and subject.
-
Machine Learning for Healthcare Wearable Devices: The Big Picture
Sabry, Farida; Eltaras, Tamer; Labda, Wadha; Alzoubi, Khawla; Malluhi, Qutaibah ( John Wiley and Sons Inc , 2022 , Article Review)Using artificial intelligence and machine learning techniques in healthcare applications has been actively researched over the last few years. It holds promising opportunities as it is used to track human activities and ... -
A cooperative Q-learning approach for online power allocation in femtocell networks
Saad H.; Mohamed A.; Elbatt T. ( IEEE , 2013 , Conference Paper)In this paper, we address the problem of distributed interference management of cognitive femtocells that share the same frequency range with macrocells using distributed multiagent Q-learning. We formulate and solve three ... -
Image Steganography: A Review of the Recent Advances
Subramanian N.; Elharrouss O.; Al-Maadeed, Somaya; Bouridane A. ( Institute of Electrical and Electronics Engineers Inc. , 2021 , Article)Image Steganography is the process of hiding information which can be text, image or video inside a cover image. The secret information is hidden in a way that it not visible to the human eyes. Deep learning technology, ...