Framework for Virtualized Network Functions (VNFs) in Cloud of Things Based on Network Traffic Services
Article Sidebar
Main Article Content
Abstract
The cloud of things (CoT), which combines the Internet of Things (IoT) and cloud computing, may offer Virtualized Network Functions (VNFs) for IoT devices on a dynamic basis based on service-specific requirements. Although the provisioning of VNFs in CoT is described as an online decision-making problem, most widely used techniques primarily focus on defining the environment using simple models in order to discover the optimum solution. This leads to inefficient and coarse-grained provisioning since the Quality of Service (QoS) requirements for different types of CoT services are not considered, and important historical experience on how to provide for the best long-term benefits is disregarded. This paper suggests a methodology for providing VNFs intelligently in order to schedule adaptive CoT resources in line with the detection of traffic from diverse network services. The system makes decisions based on Deep Reinforcement Learning (DRL) based models that take into account the complexity of network configurations and traffic changes. To obtain stable performance in this model, a special surrogate objective function and a policy gradient DRL method known as Policy Optimisation using Kronecker-Factored Trust Region (POKTR) are utilised. The assertion that our strategy improves CoT QoS through real-time VNF provisioning is supported by experimental results. The POKTR algorithm-based DRL-based model maximises throughput while minimising network congestion compared to earlier DRL algorithms.
Article Details
References
Bon_m, M., Freitas, F., Fernandes, S.: A semantic-based policy analysis solution for the deployment of nfv services. IEEE Transactions on Network and Service Management 16(3), 1005{1018 (2019).
Bouten, N., Claeys, M., Mijumbi, R., Famaey, J., Latr_e, S., Serrat, J.: Semantic validation of a_nity constrained service function chain requests. In: 2016 IEEE NetSoft Conference and Workshops (NetSoft). pp. 202{210 (June 2016).
V. Mnih, A. P. Badia, M. Mirza, A. Graves, T. Lillicrap, T. Harley, D. Silver, and K. Kavukcuoglu, “Asynchronous methods for deep reinforcement learning,” in International conference on machine learning, 2016, pp. 1928–1937.
“Architecture and mechanisms for resource elasticity provisioning,” EU H2020 project 5G-MoNArch, Deliverable D4.1,2018.
R. D. Sumit Maheshwari, Saurabh Deochake and A. Grover, “Comparative study of virtual machines and containers for devops developers instructor: Prof. richard martin,” arXiv preprint arXiv:1808.08192, 2018.
R. Sutton, , and A. G. Barto, Introduction to reinforcement learning. MIT press Cambridge, 1998, vol. 135.
D. M. Gutierrez-Estevez, M. Gramaglia, A. de Domenico, N. di Pietro, S. Khatibi, K. Shah, D. Tsolkas, P. Arnold, and P. Serrano, “The path towards resource elasticity for 5g network architecture,” in Wireless Communications and Networking Conference Workshops (WCNCW), 2018 IEEE. IEEE, 2018, pp. 214–219.
K. Narasimhan, T. D. Kulkarni, and R. Barzilay, “Language understanding for textbased games using deep reinforcement learning,” in In Proceedings of the Conference on Empirical Methods in Natural Language Processing. Citeseer, 2015.
C. Zhang, P. Patras, and H. Haddadi, “Deep learning in mobile and wireless networking: A survey,” arXiv preprint arXiv:1803.04311, 2018.
Z. Zhao, R. Li, Q. Sun, Y. Yang, X. Chen, M. Zhao, and H. Zhang, “Deep reinforcement learning for network slicing,” arXiv preprint arXiv:1805.06591, 2018.
R. Li, Z. Zhao, Q. Sun, I. Chih-Lin, C. Yang, X. Chen, M. Zhao, and H. Zhang, “Deep reinforcement learning for resource management in network slicing,” IEEE Access, vol. 6, pp. 74 429–74 441, 2018.
Ms. Nora Zilam Runera. (2014). Performance Analysis On Knowledge Management System on Project Management. International Journal of New Practices in Management and Engineering, 3(02), 08 - 13. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/28
X. Chen, Z. Zhao, C. Wu, M. Bennis, H. Liu, Y. Ji, and H. Zhang, “Multi-tenant cross-slice resource orchestration: A deep reinforcement learning approach,” IEEE Journal on Selected Areas in Communications, 2019.
C. Qi, Y. Hua, R. Li, Z. Zhao, and H. Zhang, “Deep reinforcement learning with discrete normalized advantage functions for resource management in network slicing,” arXiv:1906.04594, 2019.
T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971, 2015.
S. Fujimoto, H. van Hoof, and D. Meger, “Addressing function approximation error in actor-critic methods,” preprint arXiv:1802.09477, 2018.
Q. Zhang, Zhani, R. Boutaba, and J. L. Hellerstein, “Dynamic heterogeneity-aware resource provisioning in the cloud,” IEEE Trans. Cloud Comput., vol. 2, no. 1, pp. 14–28, 2015.
X. Zhu, L. T. Yang, H. Chen, J.Wang, S. Yin, and X. Liu, “Real-time tasks oriented energy-aware scheduling in virtualized clouds,” IEEE Trans. Cloud Comput., vol. 2, no. 2, pp. 168–180, 2014.
R. Buyya, A. Beloglazov, and J. Abawajy, “Energy-efficient management of data center resources for cloud computing - a vision, architectural elements, and open challenges,” in Parallel Distrib. Process. Tech. Appl., 2010, pp. 6–17.
A. Mosa and R. Sakellariou, “Virtual machine consolidation for cloud data centers using parameter-based adaptive allocation,” Proceedings of the Fifth European Conference on the Engineering of Computer-Based Systems (ECBS), 2017.
W. Guo, X. Ren, W. Tian, and S. Venugopal, “Self-adaptive consolidation of virtual machines for energy-efficiency in the cloud,” Proceedings of the 2017 VI International Conference on Network, Communication and Computing (ICNCC), 2017.
X. Li, Z. Qian, S. Lu, and J. Wu, “Energy efficient virtual machine placement algorithm with balanced and improved resource utilization in a data center,” Math. Comput. Model., vol. 58, no. 5-6, pp. 1222–1235, 2013. [Online]. Available: http://dx.doi.org/10.1016/j.mcm.2013.02.003.
Mohd. Tajuddin, Kabeer M., Mohammed Misbahuddin. (2023). Stress Detection Methods Using Hybrid Ontology through Social Media: Psychological Concerns. International Journal of Intelligent Systems and Applications in Engineering, 11(3s), 337–355. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2744
J. Dong, X. Jin, H. Wang, Y. Li, P. Zhang, and S. Cheng, “Energy-Saving virtual machine placement in cloud data centers,” Proc. -13th IEEE/ACM Int. Symp. Clust. Cloud, Grid Comput. CCGrid 2013,pp. 618–624, 2013.
X. Xu, W. Dou, X. Zhang, and J. Chen, “Enreal: An energy-aware resource allocation method for scientific workflow executions in cloud environment,” IEEE Transactions on Cloud Computing, vol. 4, no. 2, pp. 162–179, 2016.
X. Xu, X. Zhang, M. Khan, W. Dou, and S. Xue, “A balanced virtual machine scheduling method for energy-performance tradeoffs in cyber-physical cloud systems,” Future Generation Computer Systems, 2017.
Ahmed Ali, Anaïs Dupont,Deep Generative Models for Image Synthesis and Style Transfer , Machine Learning Applications Conference Proceedings, Vol 2 2022.
Christopher Thomas, Stephen Wright, Juan Martinez, Alejandro Perez, Luis Rodriguez. Integrating Machine Learning and Decision Science for Intelligent Automation. Kuwait Journal of Machine Learning, 2(4). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/213
Q. Chen, J. Chen, B. Zheng, J. Cui, and Y. Qian, “Utilizationbased vm consolidation scheme for power efficiency in cloud data centers,” IEEE ICC 2015-Workshop on Cloud Computing Systems, Networks, and Applications (CCSNA), pp. 1928–1933, 2015.
H. R. Faragardi, S. Dehnavi, T. Nolte, M. Kargahi, and T. Fahringer, “An energy-aware resource provisioning scheme for real-time applications in a cloud data center,” Journal of Software: Practice and Example, pp. 1–24, 2018.
H. R. Faragardi, A. Rajabi, K. Sandstr¨om, and T. Nolte, “Eaica: An energy-aware resource provisioning algorithm for real-time cloud,” 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA), 2016.
C. Pham, N. H. Tran, S. Ren, W. Saad, and C. S. Hong, “Traffic-aware and energy-efficient vnf placement for service chaining: joint sampling and matching approach,” IEEE Transactions on Services Computing, vol. 13, no. 1, pp. 172– 185, 1939.
P. T. A. Quang, Y. Hadjadj-Aoul, and A. Outtagarts, “A deep reinforcement learning approach for vnf forwarding graph embedding,” IEEE Transactions on Network and Service Management, vol. 16, no. 4, pp. 1318–1331, 2019.
J. Pei, P. Hong, M. Pan, J. Liu, and J. Zhou, “Optimal vnf placement via deep reinforcement learning in sdn/nfv-enabled networks,” IEEE Journal on Selected Areas in Communications, vol. 38, no. 2, pp. 263–278, 2020.
R. Solozabal, J. Ceberio, A. Sanchoyerto, L. Zabala, and F. Liberal, “Virtual network function placement optimization with deep reinforcement learning,” IEEE Journal on Selected Areas in Communications, vol. 38, no. 2, pp. 292–303, 2019.
L. Baojia, L. Wei, Z. Zuqing, Deep-nfvorch: leveraging deep reinforcement learning to achieve adaptive vnf service chaining in dci-eons,” IEEE/OSA Journal of Optical Communications and Networking, vol. 12, no. 1, pp. A18–A27, 2019.
L. Hu, M. Qiu, J. Song, M. S. Hossain, and A. Ghoneim. Software defined healthcare networks. IEEE Wireless Communications, 22(6):67–75, 2015.
W. Shao, F. D. Salim, T. Gu, N. Dinh, and J. Chan. Traveling officer problem: Managing car parking violations efficiently using sensor data. IEEE Internet of Things Journal, 5(2):802–810, 2018.
L. Hu and Q. Ni. Iot-driven automated object detection algorithm for urban surveillance systems in smart cities. IEEE Internet of Things Journal, 5(2):747–754, 2018.
J. Pan and J. McElhannon. Future edge cloud and edge computing for internet of things applications. IEEE Internet of Things Journal, 5(1):439–449, 2018.