PERFORMANCE IMPROVEMENT OF EDGE USERS BY UTILIZING JOINT SCHEDULING AND DEEP Q NETWORK

Lưu Bách Hưng; Lâm Sinh Công; Nguyễn Nam Hoàng

doi:10.34238/tnu-jst.7316

PERFORMANCE IMPROVEMENT OF EDGE USERS BY UTILIZING JOINT SCHEDULING AND DEEP Q NETWORK

About this article

Received: 13/02/23 Revised: 27/04/23 Published: 28/04/23

Authors

1. Luu Bach Hung, VNU – University of Engineering and Technology
2. Lam Sinh Cong , VNU – University of Engineering and Technology
3. Nguyen Nam Hoang, VNU – University of Engineering and Technology

Abstract

Improving the user performance, especially for users at cell edge areas or edge users, is one of the most important requirements of 5G and 6G cellular networks which have a high densification of base stations. This paper presents the analysis and optimization of edge user performance under the dual-slope path loss model and Rayleigh fading by utilizing advanced techniques, called Joint Scheduling (JC), and Deep Q Network (DQN) utilizing Q-learning. The dual-slope path loss model is widely used to analyze the network performance of 5G and beyond since it is able to capture the attenuation properties of the real wireless transmission environment. In a JC system, a user can proactively select the base station with the highest downlink signal to communicate with. Meanwhile, the DQN dynamically adjusts the base station transmission power to adapt to change in the wireless environment. The analytical results indicate that the deployment of JC with DQN can increase the edge user performance up to 35% or 200% more than that of the system which applies DQN only or Maximum power (MP) respectively.

Keywords

Edge user; 5G; 6G; Joint Scheduling; Deep Q Network

Full Text:

PDF (Tiếng Việt)

References

[1] M. Agiwal, A. Roy, and N. Saxena, “Next generation 5g wireless networks: A comprehensive survey,” IEEE Communications Surveys Tutorials, vol. 18, no. 3, pp. 1617–1655, 2016.

[2] T. N. H. Holma and A. Toskala, 5G Technology: 3GPP New Radio, Wiley, December 2019.

[3] L. Daewon, S. Hanbyul, B. Clerckx, E. Hardouin, D. Mazzarese, S. Nagata, and K. Sayana, “Coordinated multipoint transmission and reception in LTE-advanced: deployment scenarios and operational challenges,” IEEE Commun. Mag., vol. 50, no. 2, pp. 148–155, 2012.

[4] S. Y. Jung, H. K. Lee, and S. L. Kim, “Worst-Case User Analysis in Poisson Voronoi Cells,” IEEE Commun. Lett., vol. 17, no. 8, pp. 1580–1583, August 2013.

[5] 3GPP, “Evolved universal terrestrial radio access (e-utra); further advancements for e-utra physical layer aspects,” Technical Specification (TS) 36.300 version 9.4.0 Release 9, 3rd Generation Partnership Project (3GPP), 2018, pp.1 – 178.

[6] F. Meng, P. Chen, L. Wu, and J. Cheng, “Power allocation in multi-user cellular networks: Deep reinforcement learning approaches,” IEEE Transactions on Wireless Communications, vol. 19, no. 10, pp. 6255– 6267, 2020.

[7] B. Jang, M. Kim, G. Harerimana, and J. W. Kim, “Q-learning algorithms: A comprehensive classification and applications,” IEEE Access, vol. 7, pp. 133653–133667, 2019.

[8] L. Zhong, X. Ji, Z. Wang, J. Qin, and G.-M. Muntean, “A q-learning driven energy-aware multipath transmission solution for 5g media services,” IEEE Transactions on Broadcasting, vol. 68, no. 2, pp. 559–571, 2022.

[9] W. S. Afifi, A. A. El-Moursy, M. Saad, S. M. Nassar, and H. M. El-Hennawy, “A novel scheduling technique for improving cell-edge performance in 4G/5G systems,” Ain Shams Engineering Journal, vol. 12, no. 1, pp. 487-495, 2021.

[10] H. Mariam, I. Ahmed, S. Ali, M. I. Aslam, and I. U. Rehman, “Performance of Millimeter Wave Dense Cellular Network Using Stretched Exponential Path Loss Model,” Electronics, vol. 11, no. 24, 2022, Art. no. 4226.

[11] 3GPP, “5G; Study on channel model for frequencies from 0.5 to 100 GHz,” Technical Report (TR) 38.901 version 14.3.0 Release 14, 3rd Generation Partnership Project (3GPP), 2018, pp. 1 – 103.

[12] 3GPP, “Study on nr positioning support,” Technical Report (TR) 38.85 version 16, 3rd Generation Partnership Project (3GPP), 2018, pp. 1 – 197.

[13] 3GPP, “5G; NR; Base Station (BS) radio transmission and reception,” Technical Specification (TS) 38.104 version 15.3.0 Release 15, 3rd Generation Partnership Project (3GPP), 2018, pp. 1 – 160.

DOI: https://doi.org/10.34238/tnu-jst.7316

Refbacks

There are currently no refbacks.



Remember me