Distributed interference management using Q-Learning in cognitive femtocell networks: New USRP-based implementation
Abstract
Femtocell networks have become a promising solution in supporting high data rates for 5G systems, where cell densification is performed using the small femtocells. However, femtocell networks have many challenges. One of the major challenges of femtocell networks is the interference management problem, where deployment of femtocells in the range of macro-cells may degrade the performance of the macrocell. In this paper, we develop a new platform for studying interference management in distributed femtocell networks using reinforcement learning approach. We design a complete MAC protocol to perform distributed power allocation using Q-Learning algorithm, where both independent and cooperative learning approaches are applied across network nodes. The objective of the Q-Learning algorithms is to maximize aggregate femtocells capacity, while maintaining the QoS for the Macrocell users. Furthermore, we present the realization of the algorithms using GNURadio and USRP platforms. Performance evaluation are conducted in terms of macrocell capacity convergence to a target capacity and improvement of aggregate femtocells capacity. 2015 IEEE.
Collections
- Computer Science & Engineering [2287 items ]
- Information Intelligence [93 items ]
Related items
Showing items related by title, author, creator and subject.
-
Machine Learning for Healthcare Wearable Devices: The Big Picture
Sabry, Farida; Eltaras, Tamer; Labda, Wadha; Alzoubi, Khawla; Malluhi, Qutaibah ( John Wiley and Sons Inc , 2022 , Article Review)Using artificial intelligence and machine learning techniques in healthcare applications has been actively researched over the last few years. It holds promising opportunities as it is used to track human activities and ... -
A cooperative Q-learning approach for online power allocation in femtocell networks
Saad H.; Mohamed A.; Elbatt T. ( IEEE , 2013 , Conference Paper)In this paper, we address the problem of distributed interference management of cognitive femtocells that share the same frequency range with macrocells using distributed multiagent Q-learning. We formulate and solve three ... -
A cooperative Q-learning approach for distributed resource allocation in multi-user femtocell networks
Saad H.; Mohamed A.; El Batt T. ( Institute of Electrical and Electronics Engineers Inc. , 2016 , Conference Paper)This paper studies distributed interference management for femtocells that share the same frequency band with macrocells. We propose a multi-agent learning technique based on distributed Q-learning, called subcarrier-based ...