Resource Allocation for Heterogeneous Wireless Networks: A Robust Layered Game Learning Solutions

SHAO Hongxiang; ZHAO Hangsheng; SUN Youming; SUN Fenggang

doi:10.11999/JEIT160285

Volume 39 Issue 1

Jan. 2017

Turn off MathJax

Article Contents

Article Navigation > Journal of Electronics & Information Technology > 2017 > 39(1): 38-44

SHAO Hongxiang, ZHAO Hangsheng, SUN Youming, SUN Fenggang. Resource Allocation for Heterogeneous Wireless Networks: A Robust Layered Game Learning Solutions[J]. Journal of Electronics & Information Technology, 2017, 39(1): 38-44. doi: 10.11999/JEIT160285

Citation:

SHAO Hongxiang, ZHAO Hangsheng, SUN Youming, SUN Fenggang. Resource Allocation for Heterogeneous Wireless Networks: A Robust Layered Game Learning Solutions[J]. Journal of Electronics & Information Technology, 2017, 39(1): 38-44. doi: 10.11999/JEIT160285

Citation:

PDF( 963 KB)

Resource Allocation for Heterogeneous Wireless Networks: A Robust Layered Game Learning Solutions

doi: 10.11999/JEIT160285

1.
2.
(College of Communications Engineering, PLA University of Science and Technology, Nanjing 210007, China)

Funds:

The National Natural Science Foundation of China (61471395, 61401508), The Natural Science Foundation of Jiangsu Province, China (BK20161125)

Received Date: 2016-03-28
Rev Recd Date: 2016-10-09
Publish Date: 2017-01-19

Abstract

Abstract

This paper investigates a resource allocation scheme in heterogeneous wireless small cell networks with imperfect Channel State Information (CSI). In this work, the math expression for the stochastic dynamic uncertainty in CSI is proposed for model analysis and the robust Stackelberg game model with various interference power constraints is established firstly. Then, the Stackelberg game Equilibrium (SE) is obtained and analyzed. Lastly, an improved hierarchical Q-learning algorithm is also given to search the Stackelberg equilibrium strategies of macro-cell base station and small-cell base station. Both theoretical analysis and simulation results verify the proposed scheme can effectively restrain declining revenue due to incomplete CSI and the proposed algorithms can improves the convergence rate, especially applicable to the fast varying communication environment.
- Heterogeneous wireless networks,
- Stackelberg game,
- Incomplete Channel State Information (CSI),
- Robust decision,
- Hierarchical Q-learning,
- Discrete strategy

FullText(HTML)

References(13)

References

ZAHIR T, ARSHAD K, NAKATA A, et al. Interference management in femtocells[J]. IEEE Communication Survey Tutorials, 2013, 15(1): 293-311. doi: 10.1109/SURV.2012. 020212.00101.

HAN Zhu, NIYATO D, SAAD W, et al. Game Theory in Wireless and Communication Networks[M]. Cambridge: UK, Cambridge University Press, 2012: 88-91.

扶奉超, 张志才, 路兆铭, 等. Femtocell双层网络中基于Stackelberg博弈的节能功率控制算法[J]. 电子科技大学学报, 2015, 44(3): 363-368.

FU Fengchao, ZHANG Zhicai, LU Zhaoming, et al. Energy- efficient power control algorithm based on Stackelberg game in two-tier femtocell Networks[J]. Journal of University of Electronic Science and Technology of China, 2015, 44(3): 363-368.

LASHGARI M, MAHAM B, KEBRIAEI H, et al. Distributed power allocation and interference mitigation in two-tier femtocell networks: A game-theoretic approach[C]. Wireless Communications and Mobile Computing Conference, Dubrovnik, Croatia, 2015: 55-60.

DUONG N D, MADHUKUMAR A S, and NIYATO D. Stackelberg Bayesian game for power allocation in two-tier networks[J]. IEEE Transactions on Vehicular Technology, 2016, 65(4): 2341-2354. doi: 10.1109/TVT.2015.2418297.

ZHU Kun, HOSSAIN E, and ANPALAGAN A. Downlink power control in two-tier cellular OFDMA networks under uncertainties: A robust Stackelberg game[J]. IEEE Transactions on Communications, 2015, 63(2): 520-535. doi: 10.1109/TCOMM.2014.2382095.

吴敏, 何勇. 鲁棒控制理论[M]. 北京: 高等教育出版社, 2010.

ZHANG H, VENTURINO L, PRASAD N, et al. Weighted sum-rate maximization in multi-cell networks via coordinated scheduling and discrete power control[J]. IEEE Journal on Selected Areas in Communications, 2011, 29(6): 1214-1224. doi: 10.1109/JSAC.2011.110609.

YANG K, WU Y, and HUANG J. Distributed robust optimization for communication networks[C]. IEEE Infocom Conference, Phoenix, AZ, USA, 2008: 1157-1165. doi: 10.1109/ INFOCOM.2008.171.

FUDENBURG D and TIROLE J. Game Theory[M]. Cambridge, MA, USA, The MIT Press, 1991: 29-34.

CHEN X, ZHANG H, CHEN T et al. Improving energy efficiency in femtocell networks: A hierarchical reinforcement learning framework[C]. IEEE International Conference on Communications (ICC), Budapest, Hungary, 2013: 2241- 2245. doi: 10. 1109/ICC.2013.6654861.

WATKINS C and DAYAN P. Q-learning[J]. Journal of Machine Learning Research, 1992, 8(1): 279-292.

Relative Articles

Supplements(0)

Cited By

Proportional views