Age of Information Updates in Non-Orthogonal Multiple Access-mobile Edge Computing System Based on Reinforcement Learning

LI Baogang; SHI Tai; CHEN Jing; LI Shilu; WANG Yu; ZHANG Tiankui

doi:10.11999/JEIT211021

Volume 44 Issue 12

Dec. 2022

Turn off MathJax

Article Contents

Article Navigation > Journal of Electronics & Information Technology > 2022 > 44(12): 4238-4245

LI Baogang, SHI Tai, CHEN Jing, LI Shilu, WANG Yu, ZHANG Tiankui. Age of Information Updates in Non-Orthogonal Multiple Access-mobile Edge Computing System Based on Reinforcement Learning[J]. Journal of Electronics & Information Technology, 2022, 44(12): 4238-4245. doi: 10.11999/JEIT211021

Citation:

LI Baogang, SHI Tai, CHEN Jing, LI Shilu, WANG Yu, ZHANG Tiankui. Age of Information Updates in Non-Orthogonal Multiple Access-mobile Edge Computing System Based on Reinforcement Learning[J]. Journal of Electronics & Information Technology, 2022, 44(12): 4238-4245. doi: 10.11999/JEIT211021

Citation:

LI Baogang, SHI Tai, CHEN Jing, LI Shilu, WANG Yu, ZHANG Tiankui. Age of Information Updates in Non-Orthogonal Multiple Access-mobile Edge Computing System Based on Reinforcement Learning[J]. Journal of Electronics & Information Technology, 2022, 44(12): 4238-4245. doi: 10.11999/JEIT211021

PDF( 1177 KB)

Age of Information Updates in Non-Orthogonal Multiple Access-mobile Edge Computing System Based on Reinforcement Learning

doi: 10.11999/JEIT211021

1.
North China Electric Power University, Baoding 071003, China
2.
Xuchang Power Supply Company of State Grid Henan Electric Power Company, Xuchang 461000, China
3.
Beijing University of Posts and Telecommunications, Beijing 100876, China

Funds: The National Natural Science Foundation of China (61971190), The Fundamental Research Funds For the Central Universities (2019MS089), The Natural Science Foundation of Beijing (4164101), The Science and Technology Research Project of Colleges and Universities in Hebei (ZD2021406)

Received Date: 2021-09-26
Accepted Date: 2021-12-29
Rev Recd Date: 2021-12-16

Available Online: 2022-01-13

Publish Date: 2022-12-10

Abstract

Abstract

With the development of the Internet of Things, the demand for timeliness of information is increasing, and the freshness of information is becoming crucial. In order to maintain the freshness of information, the transmission scenario of multiple devices and single Mobile Edge Computing (MEC) server is studied in the joint system of Non-Orthogonal Multiple Access (NOMA) and MEC. In this scenario, how to allocate the amount of unload tasks and unload power to minimize the average update cost is a challenging problem. Considering the channel state variation in reality, an optimal unloading factor and unloading power decision are proposed based on Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm. Simulation results show that partial unloading can effectively reduce the average update cost, and MADDPG algorithm can further optimize the unloading power. By comparison, MADDPG algorithm is better than other schemes in reducing the average update cost, and the appropriate reduction of the number of equipment is better in reducing the average update cost.

FullText(HTML)

References(17)

References

[1]	KAUL S, YATES R, and GRUTESER M. Real-time status: How often should one update?[C]. 2012 IEEE INFOCOM, Orlando, USA, 2012: 2731–2735.
[2]	ZOU Peng, OZEL O, and SUBRAMANIAM S. Trading off computation with transmission in status update systems[C]. The IEEE 30th Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Istanbul, Turkey, 2019: 1–6.
[3]	MAO Yuyi, YOU Changsheng, ZHANG Jun, et al. A survey on mobile edge computing: The communication perspective[J]. IEEE Communications Surveys & Tutorials, 2017, 19(4): 2322–2358. doi: 10.1109/COMST.2017.2745201
[4]	LI Rui, MA Qian, GONG Jie, et al. Age of processing: Age-driven status sampling and processing offloading for edge-computing-enabled real-time IoT applications[J]. IEEE Internet of Things Journal, 2021, 8(19): 14471–14484. doi: 10.1109/JIOT.2021.3064055
[5]	LIU Long, QIN Xiaoqi, TAO Yunzheng, et al. Timely updates in MEC-assisted status update systems: Joint task generation and computation offloading scheme[J]. China Communications, 2020, 17(8): 168–186. doi: 10.23919/JCC.2020.08.014
[6]	SONG Xianxin, QIN Xiaoqi, TAO Yunzheng, et al. Age based task scheduling and computation offloading in mobile-edge computing systems[C]. 2019 IEEE Wireless Communications and Networking Conference Workshop (WCNCW), Marrakech, Morocco, 2019: 1–6.
[7]	ZENG Jie, LV Tiejun, LIU Renping, et al. Investigation on evolving single-carrier NOMA into multi-carrier NOMA in 5G[J]. IEEE Access, 2018, 6: 48268–48288. doi: 10.1109/ACCESS.2018.2868093
[8]	MAATOUK A, ASSAAD M, and EPHREMIDES A. Minimizing the age of information: NOMA or OMA?[C]. 2019 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Paris, France, 2019: 102–108.
[9]	WANG Qian, CHEN He, LI Yonghui, et al. Minimizing age of information via hybrid NOMA/OMA[C]. 2020 IEEE International Symposium on Information Theory (ISIT), Los Angeles, USA, 2020: 1753–1758.
[10]	CHEN Xiang, GONG Fengkui, LI Guo, et al. User pairing and pair scheduling in massive MIMO-NOMA systems[J]. IEEE Communications Letters, 2018, 22(4): 788–791. doi: 10.1109/LCOMM.2017.2776206
[11]	DING Zhiguo, LIU Yuanwei, CHOI J, et al. Application of non-orthogonal multiple access in LTE and 5G networks[J]. IEEE Communications Magazine, 2017, 55(2): 185–191. doi: 10.1109/MCOM.2017.1500657CM
[12]	SAITO Y, KISHIYAMA Y, BENJEBBOUR A, et al. Non-Orthogonal Multiple Access (NOMA) for cellular future radio access[C]. The IEEE 77th Vehicular Technology Conference (VTC Spring), Dresden, Germany, 2013: 1–5.
[13]	ZHOU Bo and SAAD W. Joint status sampling and updating for minimizing age of information in the internet of things[J]. IEEE Transactions on Communications, 2019, 67(11): 7468–7482. doi: 10.1109/TCOMM.2019.2931538
[14]	YU Yuehua, CHEN He, LI Yonghui, et al. On the performance of non-orthogonal multiple access in short-packet communications[J]. IEEE Communications Letters, 2018, 22(3): 590–593. doi: 10.1109/LCOMM.2017.2786252
[15]	PAN Haoyuan, LIANG Jiaxin, LIEW S C, et al. Timely information update with nonorthogonal multiple access[J]. IEEE Transactions on Industrial Informatics, 2021, 17(6): 4096–4106. doi: 10.1109/TII.2020.3006061
[16]	GÓMEZ J T, MORALES-CÉSPEDES M, ARMADA A G, et al. Minimizing age of information on NOMA communication schemes for vehicular communication applications[C]. The 12th International Symposium on Communication Systems, Networks and Digital Signal Processing (CSNDSP), Porto, Portugal, 2020: 1–6.
[17]	ELGABLI A, KHAN H, KROUKA M, et al. Reinforcement learning based scheduling algorithm for optimizing age of information in Ultra Reliable low latency networks[C]. 2019 IEEE Symposium on Computers and Communications (ISCC), Barcelona, Spain, 2019: 1–6.