Load Balancing in Distributed Cloud Computing: A Reinforcement Learning Algorithms in Heterogeneous Environment

Main Article Content

Minal Shahakar
Surenda Mahajan
Lalit Patil

Abstract

Balancing load in cloud based is an important aspect that plays a vital role in order to achieve sharing of load between different types of resources such as virtual machines that lay on servers, storage in the form of hard drives and servers. Reinforcement learning approaches can be adopted with cloud computing to achieve quality of service factors such as minimized cost and response time, increased throughput, fault tolerance and utilization of all available resources in the network, thus increasing system performance. Reinforcement Learning based approaches result in making effective resource utilization by selecting the best suitable processor for task execution with minimum makespan. Since in the earlier related work done on sharing of load, there are limited reinforcement learning based approaches. However this paper, focuses on the importance of RL based approaches for achieving balanced load in the area of distributed cloud computing. A Reinforcement Learning framework is proposed and implemented for execution of tasks in heterogeneous environments, particularly, Least Load Balancing (LLB) and Booster Reinforcement Controller (BRC) Load Balancing. With the help of reinforcement learning approaches an optimal result is achieved for load sharing and task allocation. In this RL based framework processor workload is taken as an input. In this paper, the results of proposed RL based approaches have been evaluated for cost and makespan and are compared with existing load balancing techniques for task execution and resource utilization..

Article Details

How to Cite
Shahakar, M. ., Mahajan, S. ., & Patil, L. . (2023). Load Balancing in Distributed Cloud Computing: A Reinforcement Learning Algorithms in Heterogeneous Environment. International Journal on Recent and Innovation Trends in Computing and Communication, 11(2), 65–74. https://doi.org/10.17762/ijritcc.v11i2.6130
Section
Articles

References

Mrs. Minal Shahakar, Dr. S. A. Mahajan, Dr. Lalit Patil, “Assignment Of Independent Tasks Based on Load Balancing in Distributed Cloud Systems”, J. Harbin Inst of Tech., vol. 54, pp. 301-311, 2022.

Sunghwan Kim, Seunghyun Yoon, and Hyuk Lim, “Deep Reinforcement Learning-Based Traffic Sampling for Multiple Traffic Analyzers on Software-Defined Networks”, IEEE Access, vol. 9, pp. 47815-47827, 2021.

Warangkhana Kimpan, “Multi-Objective Task Scheduling Optimization for Load Balancing in Cloud Computing Environment Using Hybrid Artificial Bee Colony Algorithm With Reinforcement Learning”, IEEE Access, vol. 10, pp. 17803-17818, 2022.

Arabinda Pradhan, Sukant Kishoro Bisoy, Sandeep Kautish, Muhammed Basheer Jasser, And Ali Wagdy Mohamed, “Intelligent Decision-Making of Load Balancing Using Deep Reinforcement Learning and Parallel PSO in Cloud Environment”, IEEE Access, vol. 10, pp. 76939-76952, 2022.

Rizwana Ahmad (Member, Ieee), And Anand Srivastava (Member, Ieee), “Sequential Load Balancing for Link Aggregation Enabled Heterogeneous LiFi WiFi Network”, J. Vehicular Technology, vol. 3, pp. 138-148, 2022.

Guoxin Liu, Student Member, IEEE, Haiying Shen, Senior Member, IEEE, and Haoyu Wang, Student Member, IEEE, “Towards Long-View Computing Load Balancing in Cluster Storage Systems”, Ieee Transactions On Parallel And Distributed Systems, VOL. 28, pp. 1770-1784, 2017.

Yu-Chieh Chuang and Wei-Yu Chiu , Member, IEEE, “Deep Reinforcement Learning Based Pricing Strategy of Aggregators Considering Renewable Energy”, Ieee Transactions On Emerging Topics In Computational Intelligence, VOL. 6, pp. 499-508, 2022.

Andrea Giordano, Alessio De Rango, Rocco Rongo, Donato D’Ambrosio, and William Spataro, “Dynamic Load Balancing in Parallel Execution of Cellular Automata”, IEEE Transactions on Parallel and Distributed Systems, Vol. 32, No. 2, 2021.

Weichao Ding , Fei Luo , Chunhua Gu, Haifeng Lu, And Qin Zhou, “Performance-to-Power Ratio Aware Resource Consolidation Framework Based on Reinforcement Learning in Cloud Data Centers”, IEEE Access, vol. 8, pp. 15472-15483, 2020.

Jia Chen, (Member, Ieee), Shihua Chen, Xin Chengand Jing Chen, (Graduate Student Member, Ieee), “A Deep Reinforcement Learning Based Switch Controller Mapping Strategy in Software Defined Network”, IEEE Access, vol. 8, pp. 221553-221567, 2020.

Eunji Hwang, Suntae Kim, Tae-kyungYoo, Jik-Soo Kim, Soonwook Hwang, and Young-ri Choi, “Resource Allocation Policies for Loosely Coupled Applications in Heterogeneous Computing Systems”, Ieee Transactions On Parallel And Distributed Systems, Vol. 27, pp. 2349-2362, 2016.

Yalan Wu , Jigang Wu , Member, IEEE, Long Chen , Jiaquan Yan, and Yinhe Han, “Load Balance Guaranteed Vehicle-to-Vehicle Computation Offloading for Min-Max Fairness in VANETs”, Ieee Transactions On Intelligent Transportation Systems, VOL. 23, pp. 11994-12013, 2022.

Xing Chen , Member, IEEE, Junqin Hu, Zheyi Chen , Bing Lin, Naixue Xiong , Senior Member, IEEE, and Geyong Min , Member, IEEE, “A Reinforcement Learning-Empowered Feedback Control System for Industrial Internet of Things”, Ieee Transactions On Industrial Informatics, VOL. 18, pp. 2724-2733, 2022.

Li Shi, Zhemin Zhang, and Thomas Robertazzi, “Energy-Aware Scheduling of Embarrassingly Parallel Jobs and Resource Allocation in Cloud”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, 2017.

Dazhao Cheng, Jia Rao, Yanfei Guo, Changjun Jiang, and Xiaobo Zhou, “Improving Performance of Heterogeneous MapReduce Clusters with Adaptive Task Tuning”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, 2017.

Zhiyao Hu , Dongsheng Li, Dongxiang Zhang , Yiming Zhang , and Baoyun Peng “Optimizing Resource Allocation for Data-Parallel Jobs Via GCN-Based Prediction”, IEEE Transactions On Parallel And Distributed Systems, Vol. 32, 2021.

Anandarup Mukherjee, Pallav Kumar Deb, and Sudip Misra, “Timed Loops for Distributed Storage in Wireless Networks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 33, 2022.

Wenzhong Guo, Jie Li, Guolong Chen, Yuzhen Niu, and Chengyu Chen, “A PSO-Optimized Real-Time Fault-Tolerant Task Allocation Algorithm in Wireless Sensor Networks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 26, 2015.

Dazhao Cheng, Xiaobo Zhou, Yu Wang and Changjun Jiang, “Adaptive Scheduling Parallel Jobs with Dynamic Batching in Spark Streaming”, IEEE Transactions On Parallel And Distributed Systems, Vol. 29, 2018.

Myeonggyun Han , Jinsu Park , and Woongki Baek, “Design and Implementation of a Criticality and Heterogeneity-Aware Runtime System for Task-Parallel Applications”, IEEE Transactions on Parallel and Distributed Systems, Vol. 32, 2021.

Renyu Yang, Chunming Hu, Xiaoyang Sun, Peter Garraghan , Tianyu Wo, Zhenyu Wen, Hao Peng , Jie Xu, “Performance-Aware Speculative Resource Oversubscription for Large-Scale Clusters”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, 2020.

Minghao Ye , Yang Hu , Junjie Zhang , Member, IEEE, Zehua Guo , Senior Member, IEEE, and H. Jonathan Chao , Life Fellow, IEEE, “Mitigating Routing Update Overhead for Traffic Engineering by Combining Destination-Based Routing With Reinforcement Learning”, Ieee Journal On Selected Areas In Communications, vol. 40, 2022.

Rizwana Ahmad, (Student Member, Ieee), Mohammad Dehghani Soltani, Majid Safari, (Member, Ieee), Anand Srivastava, (Member, Ieee), And Abir Das, “Reinforcement Learning Based Load Balancing For Hybrid LiFi WiFi Networks”, IEEE Access, vol. 8, pp. 132273-132284, 2020.

Ankit Shah , Rajesh Ganesan , Sushil Jajodia , Fellow, IEEE, Pierangela Samarati , Fellow, IEEE, and Hasan Cam, Senior Member, IEEE, “Adaptive Alert Management for Balancing Optimal Performance among Distributed CSOCs using Reinforcement Learning”, Ieee Transactions On Parallel And Distributed Systems, Vol. 31, pp. 16-33, 2020.

Qingzhi Liu , Tiancong Xia, Long Cheng , Senior Member, IEEE, Merijn van Eijk, Tanir Ozcelebi , and Ying Mao , Member, IEEE, “Deep Reinforcement Learning for Load-Balancing Aware Network Control in IoT Edge Systems”, Ieee Transactions On Parallel And Distributed Systems, Vol. 33, pp. 1491-1502, 2022.

Laiping Zhao, Yanan Yang, Ali Munir, Alex X. Liu, Yue Li, and Wenyu Qu, “Optimizing Geo-Distributed Data Analytics with Coordinated Task Scheduling and Routing”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, pp. 279-293, 2020.

Jiuchuan Jiang, Bo An, Yichuan Jiang, Senior Member, IEEE, Peng Shi, Zhan Bu, and Jie Cao, “Batch Allocation for Tasks with Overlapping Skill Requirements in Crowdsourcing”, IEEE Transactions On Parallel And Distributed Systems, Vol. 30, pp.1722-1737, 2019.

Yinghao Yu , Wei Wang , Renfei Huang , Jun Zhang , and Khaled Ben Letaief, “Achieving Load-Balanced, Redundancy-Free Cluster Caching with Selective Partition”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, pp. 439-454, 2020.

Juan Luis Jimenez Laredo, Frederic Guinand, Damien Olivier, and Pascal Bouvry, “Load Balancing at the Edge of Chaos: How Self-Organized Criticality Can Lead to Energy-Efficient Computing”, IEEE Transactions On Parallel And Distributed Systems, Vol. 28, pp. 517-529, 2017.

Alberto Cabrera, Alejandro Acosta, Francisco Almeida, and Vicente Blanco, “A Dynamic Multi–Objective Approach for Dynamic Load Balancing in Heterogeneous Systems”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, No. 10, October 2020.

YuAng Chen and Yeh-Ching Chung, “Workload Balancing via Graph Reordering on Multicore Systems”, IEEE Transactions on Parallel and Distributed Systems, Vol. 33, pp. 1231-1245, 2022.

Mahdi Jafari Siavoshani , Farzad Parvaresh , Ali Pourmiri , and Seyed Pooya Shariatpanahi, “Coded Load Balancing in Cache Networks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, pp. 347-358, 2020.

Jonatha Anselmi and Josu Doncel, “Asymptotically Optimal Size-Interval Task Assignments”, IEEE Transactions On Parallel And Distributed Systems, Vol. 30, pp. 2422-2433, 2019.

Qiong Chen, Zimu Zheng, Chuang Hu, Dan Wang, and Fangming Liu, “On-Edge Multi-Task Transfer Learning: Model and Practice With Data-Driven Task Allocation”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, pp. 1357-1371, 2020.

Ashraf Suyyagh and Zeljko Zilic, “Energy and Task-Aware Partitioning on Single-ISA Clustered Heterogeneous Processors”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, pp. 306-317, 2020.

Pingpeng Yuan, Changfeng Xie, Ling Liu, and Hai Jin, “PathGraph: A Path Centric Graph Processing System”, IEEE Transactions On Parallel And Distributed Systems, Vol. 27, pp. 2998-3012, 2016.

Lazaros Papadopoulos, Dimitrios Soudris, Christoph Kessler, August Ernstsson, Johan Ahlqvist, Nikos Vasilas, Athanasios I. Papadopoulos, Panos Seferlis, Charles Prouveur, Matthieu Haefele, Samuel Thibault, Athanasios Salamanis, Theodoros Ioakimidis, and Dionysios Kehagias, “EXA2PRO: A Framework for High Development Productivity on Heterogeneous Computing Systems”, IEEE Transactions On Parallel And Distributed Systems, Vol. 33, pp. 792-804, 2022.

Weng Chon Ao and Konstantinos Psounis, “Resource-Constrained Replication Strategies for Hierarchical and Heterogeneous Tasks”, IEEE Transactions On Parallel And Distributed Systems, Vol. 31, pp. 793-804, 2020.

Umar Ibrahim Minhas, Roger Woods, Dimitrios S. Nikolopoulos, and Georgios Karakonstantis, “Efficient Dynamic Multi-Task Execution on FPGA-Based Computing Systems”, IEEE Transactions on Parallel and Distributed Systems, Vol. 33, pp. 710-722, 2022.