A Deep Reinforcement Learning-Based Model for Optimal Resource Allocation and Task Scheduling in Cloud Computing
Article Sidebar
Main Article Content
Abstract
The advent of cloud computing has dramatically altered how information is stored and retrieved. However, the effectiveness and speed of cloud-based applications can be significantly impacted by inefficiencies in the distribution of resources and task scheduling. Such issues have been challenging, but machine and deep learning methods have shown great potential in recent years. This paper suggests a new technique called Deep Q-Networks and Actor-Critic (DQNAC) models that enhance cloud computing efficiency by optimizing resource allocation and task scheduling. We evaluate our approach using a dataset of real-world cloud workload traces and demonstrate that it can significantly improve resource utilization and overall performance compared to traditional approaches. Furthermore, our findings indicate that deep reinforcement learning (DRL)-based methods can be potent and effective for optimizing cloud computing, leading to improved cloud-based application efficiency and flexibility.
Article Details
References
Jula, A., Sundararajan, E., & Othman, Z. (2014). Cloud computing service composition: A systematic literature review. Expert Systems with Applications, 41(8), 3809–3824. https://doi.org/10.1016/j.eswa.2013.12.017
Kumari., V.Y.R., Madhav., T. B., & Kumar., L. R. (2015). Efficient and Secure Scheme for Distributed Data Storage Systems. International Journal of Computer Science and Information Technologies, Vol. 6 (1) , 2015, 839-843
Khan, T., Tian, W., Zhou, G., Ilager, S., Gong, M., & Buyya, R. (2022). Machine learning (ML)-centric resource management in cloud computing: A review and future directions. Journal of Network and Computer Applications, 204, 103405. https://doi.org/10.1016/j.jnca.2022.103405
Kumar, Y., Kaul, S., & Hu, Y.-C. (2022). Machine learning for energy-resource allocation, workflow scheduling and live migration in cloud computing: State-of-the-art survey. Sustainable Computing: Informatics and Systems, 36, 100780. https://doi.org/10.1016/j.suscom.2022.100780
Khan, A.I., Alsolami, F., Alqurashi, F., Abushark, Y.B. and Sarker, I.H., 2022. Novel energy management scheme in IoT enabled smart irrigation system using optimized intelligence methods. Engineering Applications of Artificial Intelligence, 114, p.104996.
Ding, D., Fan, X., Zhao, Y., Kang, K., Yin, Q., & Zeng, J. (2020). Q-learning based dynamic task scheduling for energy-efficient cloud computing. Future Generation Computer Systems, 108, 361–371. https://doi.org/10.1016/j.future.2020.02.018
Wang, B., Liu, F., & Lin, W. (2021). Energy-efficient VM scheduling based on deep reinforcement learning. Future Generation Computer Systems, 125, 616–628. https://doi.org/10.1016/j.future.2021.07.023
Saraswathi, A. T., Kalaashri, Y. R. A., & Padmavathi, S. (2015). Dynamic Resource Allocation Scheme in Cloud Computing. Procedia Computer Science, 47, 30–36. https://doi.org/10.1016/j.procs.2015.03.180
Aron, R., & Abraham, A. (2022). Resource scheduling methods for cloud computing environment: The role of meta-heuristics and artificial intelligence. Engineering Applications of Artificial Intelligence, 116, 105345. https://doi.org/10.1016/j.engappai.2022.105345
Zhou, G., Wen, R., Tian, W., & Rajkumar Buyya. (2022). Deep reinforcement learning-based algorithms selectors for the resource scheduling in hierarchical Cloud computing. Journal of Network and Computer Applications, 208, 103520–103520. https://doi.org/10.1016/j.jnca.2022.103520
Raghunath B. H., & Aravind H. S. (2023). An Efficient FPGA-Based Dynamic Partial Reconfigurable Implementation. International Journal of Intelligent Systems and Applications in Engineering, 11(1s), 183–192. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2471
Sarker, I.H., Khan, A.I., Abushark, Y.B. and Alsolami, F., 2022. Internet of things (iot) security intelligence: a comprehensive overview, machine learning solutions and research directions. Mobile Networks and Applications, pp.1-17. https://doi.org/10.1007/s11036-022-01937-3
Wang, H., Kang, Z., & Wang, L. (2016). Performance-Aware Cloud Resource Allocation via Fitness-Enabled Auction. IEEE Transactions on Parallel and Distributed Systems, 27(4), 1160–1173. https://doi.org/10.1109/tpds.2015.2426188
Gawali, M. B., & Shinde, S. K. (2017). Standard Deviation Based Modified Cuckoo Optimization Algorithm for Task Scheduling to Efficient Resource Allocation in Cloud Computing. Journal of Advances in Information Technology, 8(4), 210–218. https://doi.org/10.12720/jait.8.4.210-218
Gawali, M. B., & Shinde, S. K. (2018). Task scheduling and resource allocation in cloud computing using a heuristic approach. Journal of Cloud Computing, 7(1). https://doi.org/10.1186/s13677-018-0105-8
Andrew Hernandez, Stephen Wright, Yosef Ben-David, Rodrigo Costa, David Botha. Optimizing Resource Allocation using Machine Learning in Decision Science. Kuwait Journal of Machine Learning, 2(3). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/195
Pahlevan, A., Qu, X., Zapater, M., & Atienza, D. (2018). Integrating Heuristic and Machine-Learning Methods for Efficient Virtual Machine Allocation in Data Centers. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 37(8), 1667–1680. https://doi.org/10.1109/tcad.2017.2760517
Tseng, F.-H., Wang, X., Chou, L.-D., Chao, H.-C., & Victor. (2018). Dynamic Resource Prediction and Allocation for Cloud Data Center Using the Multiobjective Genetic Algorithm. IEEE Systems Journal, 12(2), 1688–1699. https://doi.org/10.1109/jsyst.2017.2722476
Du, J., F. Richard Yu, Chu, X., Li, W.-Y., & Lu, G. (2019). Computation Offloading and Resource Allocation in Vehicular Networks Based on Dual-Side Cost Minimization. IEEE Transactions on Vehicular Technology, 68(2), 1079–1092. https://doi.org/10.1109/tvt.2018.2883156
Ragmani, A., Elomri, A., Abghour, N., Moussaid, K., & Rida, M. (2019). FACO: a hybrid fuzzy ant colony optimization algorithm for virtual machine scheduling in high-performance cloud computing. Journal of Ambient Intelligence and Humanized Computing, 11(10), 3975–3987. https://doi.org/10.1007/s12652-019-01631-5
Rajesh Patel, Natural Language Processing for Fake News Detection and Fact-Checking , Machine Learning Applications Conference Proceedings, Vol 3 2023.
Velliangiri, S., Karthikeyan, P., Arul Xavier, V. M., & Baswaraj, D. (2021). Hybrid electro search with genetic algorithm for task scheduling in cloud computing. Ain Shams Engineering Journal, 12(1), 631–639. https://doi.org/10.1016/j.asej.2020.07.003
Khan, A. I., Alghamdi, A. S. A., Abushark, Y. B., Alsolami, F., Almalawi, A., & Ali, A. M. (2022). Recycling waste classification using emperor penguin optimizer with deep learning model for bioenergy production. Chemosphere, 307, 136044.
Krishnadoss, P., & Jacob, P. (2019). OLOA: Based Task Scheduling in Heterogeneous Clouds. International Journal of Intelligent Engineering and Systems, 12(1), 114–122. https://doi.org/10.22266/ijies2019.0228.12
Almalawi, A., Khan, A.I., Alsolami, F., Abushark, Y.B. and Alfakeeh, A.S., 2023. Managing Security of Healthcare Data for a Modern Healthcare System. Sensors, 23(7), p.3612. https://doi.org/10.3390/s23073612
Versluis, L., Mathá, R., Talluri, S., Hegeman, T., Prodan, R., Deelman, E., & Iosup, A. (2020). The workflow trace archive: Open-access data from public and private computing infrastructures. IEEE Transactions on Parallel and Distributed Systems, 31(9), 2170-2184. https://doi.org/10.1109/tpds.2020.2984821
Abushark, Y. B., Khan, A. I., Alsolami, F., Almalawi, A., Alam, M. M., Agrawal, A., ... & Khan, R. A. (2022). Cyber security analysis and evaluation for intrusion detection systems. Comput. Mater. Contin, 72, 1765-1783.
Calheiros, R. N., Ranjan, R., Beloglazov, A., De Rose, C. A. F., & Buyya, R. (2010). CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and Experience, 41(1), 23–50. https://doi.org/10.1002/spe.995
Raghunath, K. M. K., & Rengarajan, N. (2018). Evolving Optimal Response Time and Synchronized Communication on Integrating Fuzzy Logic Using Infrared Sensor and Sound Detecting Sensor in WSN. Sensor Letters, 16(8), 606–613. https://doi.org/10.1166/sl.2018.3993
Dastjerdi, A. V., Gupta, H., Calheiros, R. N., Ghosh, S. K., & Buyya, R. (2016). Fog Computing: principles, architectures, and applications. Internet of Things, 61–75. https://doi.org/10.1016/b978-0-12-805395-9.00004-6
Tanenbaum, A. S., & Maarten van Steen. (2007). Distributed Systems. Prentice Hall.
Singh, P., Dutta, M., & Aggarwal, N. (2017). A review of task scheduling based on meta-heuristics approach in cloud computing. Knowledge and Information Systems, 52(1), 1–51. https://doi.org/10.1007/s10115-017-1044-2
Workflow Trace Archive. (n.d.). wta.atlarge-Research.com. Retrieved April 24, 2023, from https://wta.atlarge-research.com