A cooperative Q-learning approach for distributed resource allocation in multi-user femtocell networks
Abstract
This paper studies distributed interference management for femtocells that share the same frequency band with macrocells. We propose a multi-agent learning technique based on distributed Q-learning, called subcarrier-based distributed resource allocation using Q-learning (SBDRA-Q). SBDRA-Q operates under three different learning paradigms: Independent (IL), Cooperative (CL) and Weighted Cooperative (WCL). In the IL paradigm, all femtocells learn independently from each other. In both, CL and WCL, femtocells share partial information during the learning process in order to enhance their performance. The results show that WCL outperforms both CL and IL in terms of aggregate femtocell capacity, while slightly affecting fairness. Also, the results show that CL and WCL are more robust, when compared to IL, to new femtocells being deployed during the learning process. Finally, we show SBDRA-Q achieves higher aggregate femtocell capacity under the three learning paradigms when compared to a power allocation scheme (SBDPC-Q) that was proposed in the literature. 2014 IEEE.
Collections
- Computer Science & Engineering [2127 items ]
Related items
Showing items related by title, author, creator and subject.
-
A cooperative Q-learning approach for online power allocation in femtocell networks
Saad H.; Mohamed A.; Elbatt T. ( IEEE , 2013 , Conference Paper)In this paper, we address the problem of distributed interference management of cognitive femtocells that share the same frequency range with macrocells using distributed multiagent Q-learning. We formulate and solve three ... -
Deep Learning for RF-Based Drone Detection and Identification: A Multi-Channel 1-D Convolutional Neural Networks Approach
Allahham M.S.; Khattab T.; Mohamed A. ( Institute of Electrical and Electronics Engineers Inc. , 2020 , Conference Paper)Commercial unmanned aerial vehicles, or drones, are getting increasingly popular in the last few years. The fact that these drones are highly accessible to public may bring a range of security and technical issues to ... -
Weighted Trustworthiness for ML Based Attacks Classification
Chkirbene Z.; Erbad A.; Hamila R.; Gouissem A.; Mohamed A.; Guizani M.; Hamdi M.... more authors ... less authors ( Institute of Electrical and Electronics Engineers Inc. , 2020 , Conference Paper)Recently, machine learning techniques are gaining a lot of interest in security applications as they exhibit fast processing with real-time predictions. One of the significant challenges in the implementation of these ...