A cooperative Q-learning approach for distributed resource allocation in multi-user femtocell networks
Author | Saad H. |
Author | Mohamed A. |
Author | El Batt T. |
Available date | 2022-04-21T08:58:28Z |
Publication Date | 2016 |
Publication Name | IEEE Wireless Communications and Networking Conference, WCNC |
Resource | Scopus |
Identifier | http://dx.doi.org/10.1109/WCNC.2014.6952410 |
Abstract | This paper studies distributed interference management for femtocells that share the same frequency band with macrocells. We propose a multi-agent learning technique based on distributed Q-learning, called subcarrier-based distributed resource allocation using Q-learning (SBDRA-Q). SBDRA-Q operates under three different learning paradigms: Independent (IL), Cooperative (CL) and Weighted Cooperative (WCL). In the IL paradigm, all femtocells learn independently from each other. In both, CL and WCL, femtocells share partial information during the learning process in order to enhance their performance. The results show that WCL outperforms both CL and IL in terms of aggregate femtocell capacity, while slightly affecting fairness. Also, the results show that CL and WCL are more robust, when compared to IL, to new femtocells being deployed during the learning process. Finally, we show SBDRA-Q achieves higher aggregate femtocell capacity under the three learning paradigms when compared to a power allocation scheme (SBDPC-Q) that was proposed in the literature. 2014 IEEE. |
Language | en |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Subject | Aggregates Learning systems Mobile telecommunication systems Multi agent systems Reinforcement learning Resource allocation Distributed interference managements Distributed Q-learning Distributed resource allocation Femtocell Networks Learning paradigms Multi-agent learning Partial information Q-learning approach Femtocell |
Type | Conference Paper |
Pagination | 1490-1495 |
Files in this item
Files | Size | Format | View |
---|---|---|---|
There are no files associated with this item. |
This item appears in the following Collection(s)
-
Computer Science & Engineering [2402 items ]