CEP-DTHP : A Complex Event Processing using the Dual-Tier Hybrid Paradigm Over the Stream Mining Process
Article Sidebar
Main Article Content
Abstract
CEP is a widely used technique for the reliability and recognition of arbitrarily complex patterns in enormous data streams with great performance in real time. Real-time detection of crucial events and rapid response to them are the key goals of sophisticated event processing. The performance of event processing systems can be improved by parallelizing CEP evaluation procedures. Utilizing CEP in parallel while deploying a multi-core or distributed environment is one of the most popular and widely recognized tackles to accomplish the goal. This paper demonstrates the ability to use an unusual parallelization strategy to effectively process complicated events over streams of data. This method depends on a dual-tier hybrid paradigm that combines several parallelism levels. Thread-level or task-level parallelism (TLP) and Data-level parallelism (DLP) were combined in this research. Many threads or instruction sequences from a comparable application can run concurrently under the TLP paradigm. In the DLP paradigm, instruc-tions from a single stream operate on several data streams at the same time. In our suggested model, there are four major stages: data mining, pre-processing, load shedding, and optimization. The first phase is online data mining, following which the data is materialized into a publicly available solution that combines a CEP engine with a library. Next, data pre-processing encompasses the efficient adaptation of the content or format of raw data from many, perhaps diverse sources. Finally, parallelization approaches have been created to reduce CEP processing time. By providing this two-type parallelism, our proposed solution combines the benefits of DLP and TLP while addressing their constraints. The JAVA tool will be used to assess the suggested technique. The performance of the suggested technique is compared to that of other current ways for determining the efficacy and efficiency of the proposed algorithm.
Article Details
References
Xiao, F. (2021). CEQD: A complex mass function to predict interference effects. IEEE Transactions on Cybernetics, 52(8), 7402-7414.
Roldán, J., Boubeta-Puig, J., Martínez, J. L., & Ortiz, G. (2020). Integrating complex event processing and machine learning: An intelligent architecture for detecting IoT security attacks. Expert Systems with Applications, 149, 113251.
Sahal, R., Breslin, J. G., & Ali, M. I. (2020). Big data and stream processing platforms for Industry 4.0 requirements mapping for a predictive maintenance use case. Journal of manufacturing systems, 54, 138-151.
Semlali, B. E. B., El Amrani, C., Ortiz, G., Boubeta-Puig, J., & Garcia-de-Prado, A. (2021). SAT-CEP-monitor: An air quality monitoring software architecture combining complex event processing with satellite remote sensing. Computers & Electrical Engineering, 93, 107257.
Boubeta-Puig, J., Rosa-Bilbao, J., & Mendling, J. (2021). CEPchain: A graphical model-driven solution for integrating complex event processing and blockchain. Expert Systems with Applications, 184, 115578.
Boubeta-Puig, J., Rosa-Bilbao, J., & Mendling, J. (2021). CEPchain: A graphical model-driven solution for integrating complex event processing and blockchain. Expert Systems with Applications, 184, 115578.
Sun, A. Y., Zhong, Z., Jeong, H., & Yang, Q. (2019). Building complex event processing capability for intelligent environmental monitoring. Environmental Modeling & software, 116, 1-6.
Bezerra, E. D. C., Teles, A. S., Coutinho, L. R., & da Silva e Silva, F. J. (2021). Dempster–shafer theory for modeling and treating uncertainty in iot applications based on complex event processing. Sensors, 21(5), 1863.
Moreno, N., Bertoa, M. F., Burgueño, L., & Vallecillo, A. (2019). Managing measurement and occurrence uncertainty in complex event processing systems. IEEE Access, 7, 88026-88048.
Nawaz, F., Janjua, N. K., & Hussain, O. K. (2019). PERCEPTUS: Predictive complex event processing and reasoning for IoT-enabled supply chain. Knowledge-Based Systems, 180, 133-146.
Naseri, M. M., Tabibian, S., & Homayounvala, E. (2022). Adaptive and personalized user behavior modeling in complex event processing platforms for remote health monitoring systems. Artificial Intelligence in Medicine, 134, 102421.
Slo, A., Bhowmik, S., & Rothermel, K. (2020). State-aware load shedding from input event streams in complex event processing. IEEE Transactions on Big Data, 8(5), 1340-1357.
Flouris, I., Giatrakos, N., Deligiannakis, A., & Garofalakis, M. (2020). Network-wide complex event processing over geographically distributed data sources. Information Systems, 88, 101442.
White, M., Hall, K., López, A., Muñoz, S., & Flores, A. Predictive Maintenance in Manufacturing: A Machine Learning Perspective. Kuwait Journal of Machine Learning, 1(4). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/154
Akintoye, S. B., Han, L., Zhang, X., Chen, H., & Zhang, D. (2022). A hybrid parallelization approach for distributed and scalable deep learning. IEEE Access, 10, 77950-77961.
Kumar, S., & Mohbey, K. K. (2022). A review on big data based parallel and distributed approaches of pattern mining. Journal of King Saud University-Computer and Information Sciences, 34(5), 1639-1662.
Lima, M., Lima, R., Lins, F., & Bonfim, M. (2022). Beholder–A CEP-based intrusion detection and prevention systems for IoT environments. Computers & Security, 120, 102824.
Al-Mansoori, A., Abawajy, J., & Chowdhury, M. (2020, May). BDSP in the cloud: scheduling and load balancing utlizing SDN and CEP. In 2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID) (pp. 827-835). IEEE.
Liu, Y., Yu, W., Gao, C., & Chen, M. (2022). An Auto-extraction framework for CEP rules based on the two-layer LSTM attention mechanism: A case study on city air pollution forecasting. Energies, 15(16), 5892.
Ramírez, A., Moreno, N., & Vallecillo, A. (2021). Rule?based preprocessing for data stream mining using complex event processing. Expert Systems, 38(8), e12762.
Gulisano, V., Najdataei, H., Nikolakopoulos, Y., Papadopoulos, A. V., Papatriantafilou, M., & Tsigas, P. (2022). STRETCH: Virtual shared-nothing parallelism for scalable and elastic stream processing. IEEE Transactions on Parallel and Distributed Systems, 33(12), 4221-4238.
Chapnik, K., Kolchinsky, I., & Schuster, A. (2021). DARLING: data-aware load shedding in complex event processing systems. Proceedings of the VLDB Endowment, 15(3), 541-554.
Ramírez, A., Moreno, N., & Vallecillo, A. (2021). Rule?based preprocessing for data stream mining using complex event processing. Expert Systems, 38(8), e12762.
Rajendran, P. S. ., & Kartheeswari , K. R. . (2023). Feature-Based Machine Intelligent Mapping of Cancer Beating Molecules. International Journal of Intelligent Systems and Applications in Engineering, 11(4s), 266–277. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2652
Zhao, B., Hung, N. Q. V., & Weidlich, M. (2020, April). Load shedding for complex event processing: Input-based and state-based techniques. In 2020 IEEE 36th International Conference on Data Engineering (ICDE) (pp. 1093-1104). IEEE.
Yankovitch, M., Kolchinsky, I., & Schuster, A. (2022, June). Hypersonic: A hybrid parallelization approach for scalable complex event processing. In Proceedings of the 2022 International Conference on Management of Data (pp. 1093-1107).
Lan, L., Shi, R., Wang, B., Zhang, L., & Jiang, N. (2019). A universal complex event processing mechanism based on edge computing for the Internet of Things real-time monitoring. IEEE Access, 7, 101865-101878.
Flouris, I., Giatrakos, N., Deligiannakis, A., & Garofalakis, M. (2020). Network-wide complex event processing over geographically distributed data sources. Information Systems, 88, 101442.
Mayer, R., Slo, A., Tariq, M. A., Rothermel, K., Gräber, M., & Ramachandran, U. (2017, December). SPECTRE: Supporting consumption policies in window-based parallel complex event processing. In Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference (pp. 161-173).
Traub, J., Grulich, P. M., Cuellar, A. R., Breß, S., Katsifodimos, A., Rabl, T., & Markl, V. (2021). Scotty: General and efficient open-source window aggregation for stream processing systems. ACM Transactions on Database Systems (TODS), 46(1), 1-46.
Shaikh, S. A., Matono, A., & Kim, K. S. (2020). A Distance-Window Approach for the Continuous Processing of Spatial Data Streams. International Journal of Multimedia Data Engineering and Management (IJMDEM), 11(2), 16-30.
Nihar Ranjan, Midhun C. (2020). A Brief Survey of Machine Learning Algorithms for Text Document Classification on Incremental Database. TEST Engineering and Management, ISSN: 0193-4120, Volume 83, 25246 – 25251.
Nihar Ranjan, Midhun C. (2021). Evolutionary and Incremental Text Document Classifier using Deep Learning” International Journal of Grid and Distributed Computing Vol. 14, No. 1, 587-595.
Nihar Ranjan, Zubair Ghouse. (2017). A Multi-function Robot for Military Application. Imperial Journal of Interdisciplinary Research (IJIR) Vol-3, Issue-3, ISSN: 2454-1362, 1785-1788.