Automated Identification and Localization of Brain Tumor in MRI Using U-Net Segmentation and CNN-LSTM Classification

Main Article Content

Chandrakantha T S
Basavaraj N Jagadale
Abhisheka T E
Omar Abdullah Murshed Farhan Alnaggar

Abstract

Nowadays, the use of computers to evaluate medical images automatically is critical part of the life. Today's treatment method relies heavily on early diagnosis and accurate disease identification, which were formerly difficult for medical research to achieve. Brain Magnetic Resonance Imaging (MRI) is essential to the detection and treatment of brain tumor (BT). Tumor of the brain are the result of brain cell division that has gone awry or is otherwise out of control. The manual MRI segmentation of BT is a difficult and time-consuming process. The most critical factor in the effective treatment and identification of BT is the ability to accurately locate the tumor. The detection of BT is regarded as a difficult task in medical image processing. For analysing and interpreting MRI, there are semi-automatic and fully automated systems that require large-scale professional input and evaluation, with varying degrees of effectiveness. Automated identification and extraction of the tumor's localization from brain MRI will be proposed in this paper. To achieve this goal, the data collected from Kaggle and the collected data are processed. Then the U-Net is employed to segment the tumor region from the MRI. Next, the MRI is classified using DL models like Convolutional Neural Network (CNN), and the hybrid Convolutional Neural Network and Long Short-Term Memory (CNN-LSTM). Both process segmentation and classification are evaluated using the metrics. From the evaluation, it is identified that CNN-LSTM outperforms the CNN model.

Article Details

How to Cite
T S, C. ., Jagadale, B. N. ., T E, A. ., & Farhan Alnaggar, O. A. M. . (2023). Automated Identification and Localization of Brain Tumor in MRI Using U-Net Segmentation and CNN-LSTM Classification. International Journal on Recent and Innovation Trends in Computing and Communication, 11(10s), 637–644. https://doi.org/10.17762/ijritcc.v11i10s.7703
Section
Articles

References

Louis, David N., Arie Perry, Guido Reifenberger, Andreas Von Deimling, Dominique Figarella-Branger, Webster K. Cavenee, Hiroko Ohgaki, Otmar D. Wiestler, Paul Kleihues, and David W. Ellison. "The 2016 World Health Organization classification of tumors of the central nervous system: a summary." Acta neuropathologica 131 (2016): 803-820.

Khan, Amjad Rehman, Siraj Khan, Majid Harouni, Rashid Abbasi, Sajid Iqbal, and Zahid Mehmood. "Brain tumor segmentation using K?means clustering and deep learning with synthetic data augmentation for classification." Microscopy Research and Technique 84, no. 7 (2021): 1389-1399.

Logeswari, T., and M. Karnan. "An improved implementation of brain tumor detection using segmentation based on hierarchical self organizing map." International Journal of Computer Theory and Engineering 2, no. 4 (2010): 591.

Wen, P., Land Zheng, and J. Zhou. "Spatial credibilistic clustering algorithm in noise image segmentation." In 2007 IEEE International Conference on Industrial Engineering and Engineering Management, pp. 543-547. IEEE, 2007.

Habib, Hassan, Awais Mehmood, Tahira Nazir, Marrium Nawaz, Momina Masood, and Rabbia Mahum. "Brain Tumor Segmentation and Classification using Machine Learning." In 2021 International Conference on Applied and Engineering Mathematics (ICAEM), pp. 13-18. IEEE, 2021.

Tazeen, Tasmiya, Mrinal Sarvagya, and M. Sarvagya. "Brain tumor segmentation and classification using multiple feature extraction and convolutional neural networks." International Journal of Engineering and Advanced Technology 10, no. 6 (2021): 23-27.

Díaz-Pernas, Francisco Javier, Mario Martínez-Zarzuela, Míriam Antón-Rodríguez, and David González-Ortega. "A deep learning approach for brain tumor classification and segmentation using a multiscale convolutional neural network." In Healthcare, vol. 9, no. 2, p. 153. MDPI, 2021.

Bal, Abhishek, Minakshi Banerjee, Punit Sharma, and Mausumi Maitra. "Brain tumor segmentation on MR image using K-Means and fuzzy-possibilistic clustering." In 2018 2nd international conference on electronics, materials engineering & nano-technology (IEMENTech), pp. 1-8. IEEE, 2018.

Malathi, M., and P. Sinthia. "MRI brain tumour segmentation using hybrid clustering and classification by back propagation algorithm." Asian Pacific Journal of Cancer Prevention: APJCP 19, no. 11 (2018): 3257.

Karaye?en, Gökay, and Mehmet Feyzi Ak?ahin. "Brain Tumor Prediction with Deep Learning and Tumor Volume Calculation." In 2021 Medical Technologies Congress (TIPTEKNO), pp. 1-4. IEEE, 2021.

Asif, Sohaib, Wenhui Yi, Qurrat Ul Ain, Jin Hou, Tao Yi, and Jinhai Si. "Improving Effectiveness of Different Deep Transfer Learning-Based Models for Detecting Brain Tumors from MR Images." IEEE Access 10 (2022): 34716-34730.

Raj, G. ., Verma, A. ., Dalal, P. ., Shukla, A. K. ., & Garg, P. . (2023). Performance Comparison of Several LPWAN Technologies for Energy Constrained IOT Network. International Journal of Intelligent Systems and Applications in Engineering, 11(1s), 150–158. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2487

Ranjbarzadeh, Ramin, Nazanin Tataei Sarshar, Saeid Jafarzadeh Ghoushchi, Mohammad Saleh Esfahani, Mahboub Parhizkar, Yaghoub Pourasad, Shokofeh Anari, and Malika Bendechache. "MRFE-CNN: multi-route feature extraction model for breast tumor segmentation in Mammograms using a convolutional neural network." Annals of Operations Research (2022): 1-22.

Baseri Saadi, Soroush, Nazanin Tataei Sarshar, Soroush Sadeghi, Ramin Ranjbarzadeh, Mersedeh Kooshki Forooshani, and Malika Bendechache. "Investigation of effectiveness of shuffled frog-leaping optimizer in training a convolution neural network." Journal of Healthcare Engineering 2022 (2022).

Tataei Sarshar, Nazanin, Ramin Ranjbarzadeh, Saeid Jafarzadeh Ghoushchi, Gabriel Gomes de Oliveira, Shokofeh Anari, Mahboub Parhizkar, and Malika Bendechache. "Glioma Brain Tumor Segmentation in Four MRI Modalities Using a Convolutional Neural Network and Based on a Transfer Learning Method." In Proceedings of the 7th Brazilian Technology Symposium (BTSym’21) Emerging Trends in Human Smart and Sustainable Future of Cities (Volume 1), pp. 386-402. Cham: Springer International Publishing, 2022.

Ms. Nora Zilam Runera. (2014). Performance Analysis On Knowledge Management System on Project Management. International Journal of New Practices in Management and Engineering, 3(02), 08 - 13. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/28

Ranjbarzadeh, Ramin, Abbas Bagherian Kasgari, Saeid Jafarzadeh Ghoushchi, Shokofeh Anari, Maryam Naseri, and Malika Bendechache. "Brain tumor segmentation based on deep learning and an attention mechanism using MRI multi-modalities brain images." Scientific Reports 11, no. 1 (2021): 1-17.

Miller, J., Evans, A., Martinez, J., Perez, A., & Silva, D. Predictive Maintenance in Engineering Facilities: A Machine Learning Approach. Kuwait Journal of Machine Learning, 1(2). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/113

https://www.kaggle.com/datasets/mateuszbuda/lgg-mri-segmentation

Danon, Dov, Moab Arar, Daniel Cohen-Or, and Ariel Shamir. "Image resizing by reconstruction from deep features." Computational Visual Media 7, no. 4 (2021): 453-466.

Ding, Pengpeng, Jinguo Li, Liangliang Wang, Mi Wen, and Yuyao Guan. "HYBRID-CNN: An efficient scheme for abnormal flow detection in the SDN-Based Smart Grid." Security and communication networks 2020 (2020): 1-20.

Miko?ajczyk, Agnieszka, and Micha? Grochowski. "Data augmentation for improving deep learning in image classification problem." In 2018 international interdisciplinary PhD workshop (IIPhDW), pp. 117-122. IEEE, 2018.

Shorten, Connor, and Taghi M. Khoshgoftaar. "A survey on image data augmentation for deep learning." Journal of big data 6, no. 1 (2019): 1-48.

Li, Lin, Peeter Ross, Maarja Kruusmaa, and Xiaosong Zheng. "A comparative study of ultrasound image segmentation algorithms for segmenting kidney tumors." In Proceedings of the 4th international symposium on applied sciences in biomedical and communication technologies, pp. 1-5. 2011.

Siddique, Nahian, Sidike Paheding, Colin P. Elkin, and Vijay Devabhaktuni. "U-net and its variants for medical image segmentation: A review of theory and applications." IEEE Access 9 (2021): 82031-82057.

Yin, Xiao-Xia, Le Sun, Yuhan Fu, Ruiliang Lu, and Yanchun Zhang. "U-Net-Based medical image segmentation." Journal of Healthcare Engineering (2022).

Faris, W. F. . (2020). Cataract Eye Detection Using Deep Learning Based Feature Extraction with Classification. Research Journal of Computer Systems and Engineering, 1(2), 20:25. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/7

Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. "U-net: Convolutional networks for biomedical image segmentation." In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pp. 234-241. Springer International Publishing, 2015.

Liu, Tianyi, Shuangsang Fang, Yuehui Zhao, Peng Wang, and Jun Zhang. "Implementation of training convolutional neural networks." arXiv preprint arXiv:1506.01195 (2015).

Rashid, Junaid, Saba Batool, Jungeun Kim, Muhammad Wasif Nisar, Amir Hussain, Sapna Juneja, and Riti Kushwaha. "An augmented artificial intelligence approach for chronic diseases prediction." Frontiers in Public Health 10 (2022).

Ayadi, Wadhah, Wajdi Elhamzi, Imen Charfi, and Mohamed Atri. "Deep CNN for brain tumor classification." Neural Processing Letters 53 (2021): 671-700.

Luan, Yuandong, and Shaofu Lin. "Research on text classification based on CNN and LSTM." In 2019 IEEE international conference on artificial intelligence and computer applications (ICAICA), pp. 352-355. IEEE, 2019.

Chen, Gang. "A gentle tutorial of recurrent neural network with error backpropagation." arXiv preprint arXiv:1610.02583 (2016).

Hochreiter, Sepp. "The vanishing gradient problem during learning recurrent neural nets and problem solutions." International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 6, no. 02 (1998): 107-116.