A Transmission and Scheduling Scheme Based on Markov Decision Process in Cognitive Radio Networks

Hossain E and Bhargava V. Cognitive WirelessCommunication Networks [M]. First Edition, New York:Springer, 2007: 1-301.[2]Djonin D V, et al.. Joint rate and power adaptation for type-Ihybrid ARQ systems over correlated fading channels underdifferent buffer cost constraints [J]. IEEE Transactions. onWireless Communications, 2008, 57(1): 421-435.[3]Bolch G.[J].et al.. Queueing Networks and Markov Chains:Modeling and Performance Evaluation with ComputerScience Applications [M]. Second Edition, New York: JohnWiley Sons.2006,:-[4]Chung Seong Taek and Goldsmith A. Degrees of freedom inadaptive modulation: A unified view [J].IEEE Transactions.on Communications.2001, 49(9):1561-1571[5]Chang H S, et al.. Simulation-based Algorithms for MarkovDecision Processes [M]. First Edition, London: Springer-Verlag, 2007: 9-167.[6]Beutle F J and Ross K W. Optimal policies for controlledmarkov chains with a constraint [J]. Journal of MathematicalAnalysis and Application, 1985, 112(1): 236-252.[7]Hossain M J, et al.. Delay limited optimal and suboptimalpower and bit loading algorithms for OFDM systems overcorrelated fading [C]. IEEE GLOBECOM, St. Louis, USA,Dec. 1-2, 2005: 3448-3453.[8]Pandana C and Liu K J R. Near-optimal reinforcementlearning framework for energy-aware sensor communications[J]. IEEE Transactions. on Wireless Communications, 2005,23(4): 788-797.