Deep Reinforcement Learning for Satellite–Terrestrial Integrated Network Slice Resource Scheduling
Keywords:
satellite–terrestrial integration, network slicing, deep reinforcement learning, resource scheduling, 6G architecture, governanceAbstract
The convergence of non-terrestrial and terrestrial communication infrastructures into a unified satellite–terrestrial integrated network represents a defining architectural ambition for sixth-generation systems. This integration promises ubiquitous coverage, enhanced resilience, and flexible service provisioning, yet it simultaneously introduces formidable resource orchestration challenges. Network slicing, which enables the coexistence of multiple logical networks over a shared physical substrate, is essential for delivering differentiated quality of service across such a heterogeneous domain. Traditional resource allocation heuristics struggle to cope with the high-dimensional state spaces, multi-timescale dynamics, and stringent latency constraints inherent to hybrid satellite–terrestrial slices. This paper presents a system-level investigation into the application of deep reinforcement learning for end-to-end slice resource scheduling in integrated space–ground architectures. The discussion focuses on structural trade-offs, deployment implications, multi-objective fairness, governance frameworks, and sustainability considerations rather than on mathematical formulations. An extensive analysis is offered of how centralized and distributed learning agents can reason about spectrum, beam, storage, and computational resources across moving satellite nodes and stationary terrestrial cells. The paper further examines robustness under orbital mobility and sudden link interruptions, explores governance mechanisms for cross-operator slicing, and positions future developments around digital twins, zero-trust security, and intent-based networking. The study provides a broad architectural discourse intended to guide the engineering of autonomous, resilient, and equitable slice schedulers in next-generation satellite–terrestrial systems.
References
1. Kodheli, O., Lagunas, E., Maturo, N., Sharma, S. K., Shankar, B., Montoya, J. F. M., ... & Goussetis, G. (2021). Satellite communications in the new space era: A survey and future challenges. IEEE Communications Surveys & Tutorials, 23(1), 70–109.
2. Guidotti, A., Vanelli-Coralli, A., Conti, M., Andrenacci, S., Chatzinotas, S., Maturo, N., ... & Goussetis, G. (2019). Architectures and key technical challenges for 5G systems incorporating satellites. IEEE Transactions on Vehicular Technology, 68(3), 2624–2639.
3. Foukas, X., Patounas, G., Elmokashfi, A., & Marina, M. K. (2017). Network slicing in 5G: Survey and challenges. IEEE Communications Magazine, 55(5), 94–100.
4. Luong, N. C., Hoang, D. T., Gong, S., Niyato, D., Wang, P., Liang, Y. C., & Kim, D. I. (2019). Applications of deep reinforcement learning in communications and networking: A survey. IEEE Communications Surveys & Tutorials, 21(4), 3133–3174.
5. Mao, H., Alizadeh, M., Menache, I., & Kandula, S. (2016). Resource management with deep reinforcement learning. In Proceedings of the 15th ACM Workshop on Hot Topics in Networks (pp. 50–56).
6. Li, R., Zhao, Z., Sun, Q., I, C. L., Yang, C., Chen, X., ... & Zhang, H. (2018). Deep reinforcement learning for resource management in network slicing. IEEE Access, 6, 74429–74441.
7. Sun, Y., Peng, M., Zhou, Y., Huang, Y., & Mao, S. (2019). Application of machine learning in wireless networks: Key techniques and open issues. IEEE Communications Surveys & Tutorials, 21(4), 3072–3108.
8. Jiang, C., & Zhu, X. (2020). Reinforcement learning based capacity management in multi-layer satellite networks. IEEE Transactions on Vehicular Technology, 69(3), 3207–3219.
9. Liu, S., & Lv, T. (2020). Deep reinforcement learning for delay-aware resource allocation in satellite-terrestrial integrated networks. IEEE Access, 8, 145599–145612.
10. Cheng, N., Lyu, F., Quan, W., Zhou, C., He, H., Shi, W., & Shen, X. (2019). Space/aerial-assisted computing offloading for IoT applications: A learning-based approach. IEEE Journal on Selected Areas in Communications, 37(5), 1117–1129.
11. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., & Klimov, O. (2017). Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347.
12. Zhang, H., Li, Y., Jin, D., & Chen, S. (2019). Toward 6G wireless networks: A machine learning-oriented perspective. IEEE Network, 33(5), 116–121.
13. Saad, W., Bennis, M., & Chen, M. (2020). A vision of 6G wireless systems: Applications, trends, technologies, and open research problems. IEEE Network, 34(3), 134–142.
14. 3GPP TR 38.811. (2020). Study on new radio (NR) to support non-terrestrial networks (Release 15). 3rd Generation Partnership Project.
15. Kato, N., Fadlullah, Z. M., Tang, F., Mao, B., Tani, S., Okamura, A., & Liu, J. (2019). Optimizing space-air-ground integrated networks by artificial intelligence. IEEE Wireless Communications, 26(4), 140–147.
16. Liu, J., Shi, Y., Fadlullah, Z. M., & Kato, N. (2018). Space-air-ground integrated network: A survey. IEEE Communications Surveys & Tutorials, 20(4), 2714–2741.
17. Xiong, Z., Zhang, Y., Niyato, D., Wang, P., & Han, Z. (2019). When mobile blockchain meets edge computing: A survey. IEEE Communications Surveys & Tutorials, 21(3), 2675–2710.
18. Li, Q. (2026). QoS Assurance Mechanism for 5G Network Slicing Based on the Deep Reinforcement Learning PPO Algorithm. arXiv preprint arXiv:2605.03345.
19. Chen, M., Challita, U., Saad, W., Yin, C., & Debbah, M. (2019). Artificial neural networks-based machine learning for wireless networks: A tutorial. IEEE Communications Surveys & Tutorials, 21(4), 3039–3071.
20. Mao, B., Kawamoto, Y., & Kato, N. (2020). AI-based joint optimization of QoS and security for 6G energy harvesting networks. IEEE Network, 34(2), 182–189.
21. Ouyang, Y., Wang, C., Chen, H. H., & Evans, B. G. (2021). A survey of resource allocation in multibeam satellite systems. IEEE Communications Surveys & Tutorials, 23(2), 1284–1327.
22. Tao, X., Duan, Y., Xu, X., & Chen, H. H. (2020). On the application of digital twins for 6G networks. IEEE Network, 34(6), 196–203.
23. Sharma, P. K., Park, J. H., & Cho, K. (2018). Blockchain based hybrid network architecture for the smart city. Future Generation Computer Systems, 86, 650–655.
24. Pujol, R., Sánchez, L., Kousias, K., Guerrero, C., & Maheshwari, S. (2024). Intent-based networking for 6G: Vision, architecture, and challenges. IEEE Communications Magazine, 62(3), 52–58.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 International Journal of Artificial Intelligence Engineering and Systems
This work is licensed under a Creative Commons Attribution 4.0 International License.
This article is published under the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
