Dynamic Classification of Sentiments from Restaurant Reviews Using Novel Fuzzy-Encoded LSTM
Article Sidebar
Main Article Content
Abstract
User reviews on social media have sparked a surge in interest in the application of sentiment analysis to provide feedback to the government, public and commercial sectors. Sentiment analysis, spam identification, sarcasm detection and news classification are just few of the uses of text mining. For many firms, classifying reviews based on user feelings is a significant and collaborative effort. In recent years, machine learning models and handcrafted features have been used to study text classification, however they have failed to produce encouraging results for short text categorization. Deep neural network based Long Short-Term Memory (LSTM) and Fuzzy logic model with incremental learning is suggested in this paper. On the basis of F1-score, accuracy, precision and recall, suggested model was tested on a large dataset of hotel reviews. This study is a categorization analysis of hotel review feelings provided by hotel customers. When word embedding is paired with LSTM, findings show that the suggested model outperforms current best-practice methods, with an accuracy 81.04%, precision 77.81%, recall 80.63% and F1-score 75.44%. The efficiency of the proposed model on any sort of review categorization job is demonstrated by these encouraging findings.
Article Details
References
Donthu, Naveen, Satish Kumar, Neeraj Pandey, Nitesh Pandey, and Akanksha Mishra. "Mapping the electronic word-of-mouth (eWOM) research: A systematic review and bibliometric analysis." Journal of Business Research 135 (2021): 758-773.
Nieto-García, Marta, Pablo A. Muñoz-Gallego, and Óscar González-Benito. "Tourists’ willingness to pay for an accommodation: The effect of eWOM and internal reference price." International Journal of Hospitality Management 62 (2017): 67-77.
Liu, Bing. "Sentiment analysis and opinion mining." Synthesis lectures on human language technologies 5, no. 1 (2012): 1-167.
Pang, Bo, Lillian Lee, and Shivakumar Vaithyanathan. "Thumbs up? Sentiment classification using machine learning techniques." arXiv preprint cs/0205070 (2002).
Pontiki, Maria, Dimitrios Galanis, Haris Papageorgiou, Ion Androutsopoulos, Suresh Manandhar, Mohammad Al-Smadi, Mahmoud Al-Ayyoub et al. "Semeval-2016 task 5: Aspect based sentiment analysis." In International workshop on semantic evaluation, pp. 19-30. 2016.
Pontiki, Maria, Dimitrios Galanis, Harris Papageorgiou, Suresh Manandhar, and Ion Androutsopoulos. "Semeval-2015 task 12: Aspect based sentiment analysis." In Proceedings of the 9th international workshop on semantic evaluation (SemEval 2015), pp. 486-495. 2015.
Pontiki, Maria, Dimitrios Galanis, Haris Papageorgiou, Ion Androutsopoulos, Suresh Manandhar, Mohammad Al-Smadi, Mahmoud Al-Ayyoub et al. "Semeval-2016 task 5: Aspect based sentiment analysis." In International workshop on semantic evaluation, pp. 19-30. 2016.
Pang, Bo, and Lillian Lee. "Opinion mining and sentiment analysis." Foundations and Trends® in information retrieval 2, no. 1–2 (2008): 1-135.
Tsytsarau, Mikalai, and Themis Palpanas. "Survey on mining subjective data on the web." Data Mining and Knowledge Discovery 24, no. 3 (2012): 478-514.
H. Tang, S. Tan, and X. Cheng, “A survey on sentiment detection of reviews,” Expert Systems with Applications, vol. 36, no. 7, pp. 10 760– 10 773, 2009.
Wang, Shuai, Zhiyuan Chen, and Bing Liu. "Mining aspect-specific opinion using a holistic lifelong topic model." In Proceedings of the 25th international conference on world wide web, pp. 167-176. 2016.
Chen, Zhiyuan, Arjun Mukherjee, and Bing Liu. "Aspect extraction with automated prior knowledge learning." In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 347-358. 2014.
Mei, Qiaozhu, Xu Ling, Matthew Wondra, Hang Su, and ChengXiang Zhai. "Topic sentiment mixture: modeling facets and opinions in weblogs." In Proceedings of the 16th international conference on World Wide Web, pp. 171-180. 2007.
Poria, Soujanya, Erik Cambria, and Alexander Gelbukh. "Aspect extraction for opinion mining with a deep convolutional neural network." Knowledge-Based Systems 108 (2016): 42-49.
Irsoy, Ozan, and Claire Cardie. "Opinion mining with deep recurrent neural networks." In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp. 720-728. 2014.
Lu, Yue, and Chengxiang Zhai. "Opinion integration through semi-supervised topic modeling." In Proceedings of the 17th international conference on World Wide Web, pp. 121-130. 2008.
L. Jiang, M. Yu, M. Zhou, X. Liu, and T. Zhao, “Target-dependent twitter sentiment classification,” in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1. Association for Computational Linguistics, 2011, pp. 151–160.
S. Kiritchenko, X. Zhu, C. Cherry, and S. Mohammad, “Nrc-canada- 2014: Detecting aspects and sentiment in customer reviews,” in Proceed- ings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), 2014, pp. 437–442.
D. Tang, B. Qin, and T. Liu, “Aspect level sentiment classification with deep memory network,” in Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, pp. 214–224.
S. Moghaddam and M. Ester, “The FLDA model for aspect-based opinion mining: Addressing the cold start problem,” in Proceedings of the 22nd international conference on World Wide Web. ACM, 2013, pp. 909–918.
G. Qiu, B. Liu, J. Bu, and C. Chen, “Opinion word expansion and target extraction through double propagation,” Computational linguistics, vol. 37, no. 1, pp. 9–27, 2011.
D.-T. Vo and Y. Zhang, “Target-dependent twitter sentiment classification with rich automatic features.” in IJCAI, 2015, pp. 1347–1353.
R. Socher, C. C. Lin, C. Manning, and A. Y. Ng, “Parsing natural scenes and natural language with recursive neural networks,” in Proceedings of the 28th international conference on machine learning (ICML-11), 2011, pp. 129–136.
Londhe, Alka, and P. V. R. D. Rao. " Incremental Learning Based Optimized Sentiment Classification using Hybrid Two-Stage LSTM-SVM Classifier" In International Journal of Advanced Computer Science and Applications, in Press.
Sally Fouad Shady. (2021). Approaches to Teaching a Biomaterials Laboratory Course Online. Journal of Online Engineering Education, 12(1), 01–05. Retrieved from http://onlineengineeringeducation.com/index.php/joee/article/view/43
L. Dong, F. Wei, C. Tan, D. Tang, M. Zhou, and K. Xu, “Adaptive recursive neural network for target-dependent twitter sentiment classi- fication,” in Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), vol. 2, 2014, pp. 49–54.
T. H. Nguyen and K. Shirai, “Phrasernn: Phrase recursive neural network for aspect-based sentiment analysis,” in Proceedings of the 2015 Confer- ence on Empirical Methods in Natural Language Processing, 2015, pp. 2509–2514.
M. Zhang, Y. Zhang, and D.-T. Vo, “Gated neural networks for targeted sentiment analysis.” in AAAI, 2016, pp. 3087–3093.
D. Tang, B. Qin, X. Feng, and T. Liu, “Effective lstms for target- dependent sentiment classification,” in Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Techni- cal Papers, 2016, pp. 3298–3307.
Y. Ma, H. Peng, and E. Cambria, “Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive lstm,” in Proceedings of AAAI, 2018, pp. 5876–5883.
Londhe, Alka, and P. V. R. D. Rao. "Aspect Based Sentiment Analysis–An Incremental Model Learning Approach Using LSTM-RNN." In International Conference on Advances in Computing and Data Sciences, pp. 677-689. Springer, Cham, 2021.
S. Ruder, P. Ghaffari, and J. G. Breslin, “A hierarchical model of reviews for aspect-based sentiment analysis,” in Proceedings of the 2016 Confer- ence on Empirical Methods in Natural Language Processing, 2016, pp. 999–1005.
Y. Kim, C. Denton, L. Hoang, and A. M. Rush, “Structured attention networks,” arXiv preprint arXiv:1702.00887, 2017.
T. Luong, H. Pham, and C. D. Manning, “Effective approaches to attention-based neural machine translation,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015, pp. 1412–1421
D. Bahdanau, K. Cho, and Y. Bengio, “Neural machine translation by jointly learning to align and translate,” arXiv preprint arXiv:1409.0473, 2014.
A. Kumar, O. Irsoy, P. Ondruska, M. Iyyer, J. Bradbury, I. Gulrajani, V. Zhong, R. Paulus, and R. Socher, “Ask me anything: Dynamic memory networks for natural language processing,” in International Conference on Machine Learning, 2016, pp. 1378–1387.
S. Sukhbaatar, J. Weston, R. Fergus et al., “End-to-end memory net- works,” in Advances in neural information processing systems, 2015, pp. 2440–2448.
K. M. Hermann, T. Kocisky, E. Grefenstette, L. Espeholt, W. Kay, M. Su- leyman, and P. Blunsom, “Teaching machines to read and comprehend,” in Advances in Neural Information Processing Systems, 2015, pp. 1693– 1701.
M. Seo, A. Kembhavi, A. Farhadi, and H. Hajishirzi, “Bidirectional atten- tion flow for machine comprehension,” arXiv preprint arXiv:1611.01603, 2016.
R. He, W. S. Lee, H. T. Ng, and D. Dahlmeier, “Effective attention modeling for aspect-level sentiment classification,” in Proceedings of the 27th International Conference on Computational Linguistics, 2018, pp. 1121–1131.
Alrawashdeh, R., Al-Fawa’reh, M., & Mardini, W. (2022). Enhanced Epileptic Seizure diagnosis using EEG Signals with Support vector machine and Bagging Classifiers. International Journal of Communication Networks and Information Security (IJCNIS), 13(3).
Y. Tay, A. T. Luu, and S. C. Hui, “Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis,” in Proceedings of AAAI, 2018, pp. 5956–5963.
J. Zeng, X. Ma, and K. Zhou, “Enhancing attention-based LSTM with position context for aspect-level sentiment classification,” IEEE Access, vol. 7, pp. 20 462–20 471, 2019.
R. He, W. S. Lee, H. T. Ng, and D. Dahlmeier, “Exploiting document knowledge for aspect-level sentiment classification,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguis- tics. Association for Computational Linguistics, 2018, pp. 579–585.
D. Hazarika, S. Poria, P. Vij, G. Krishnamurthy, E. Cambria, and R. Zimmermann, “Modeling inter-aspect dependencies for aspect-based sentiment analysis,” in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), vol. 2, 2018, pp. 266–270.
S. Gu, L. Zhang, Y. Hou, and Y. Song, “A position-aware bidirectional attention network for aspect-level sentiment analysis,” in Proceedings of the 27th International Conference on Computational Linguistics, 2018, pp. 774–784.
Q. Liu, H. Zhang, Y. Zeng, Z. Huang, and Z. Wu, “Content attention model for aspect based sentiment analysis,” in Proceedings of the 2018 World Wide Web Conference on World Wide Web. International World Wide Web Conferences Steering Committee, 2018, pp. 1023–1032.
Y. Wang, M. Huang, L. Zhao et al., “Attention-based lstm for aspect- level sentiment classification,” in Proceedings of the 2016 conference on empirical methods in natural language processing, 2016, pp. 606–615
D. Ma, S. Li, X. Zhang, and H. Wang, “Interactive attention networks for aspect-level sentiment classification,” in IJCAI, 2017, pp. 4068–4074.
J. Liu and Y. Zhang, “Attention modeling for targeted sentiment,” in Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers, vol. 2, 2017, pp. 572–577.
F. Fan, Y. Feng, and D. Zhao, “Multi-grained attention network for aspect-level sentiment classification,” in Proceedings of the 2018 Con- ference on Empirical Methods in Natural Language Processing, 2018, pp. 3433–3442.
B. Huang, Y. Ou, and K. M. Carley, “Aspect level sentiment classification with attention-over-attention neural networks,” in SBP-BRiMS, 2018.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in neural infor- mation processing systems, 2012, pp. 1097–1105.
Y. Kim, “Convolutional neural networks for sentence classification,” arXiv preprint arXiv:1408.5882, 2014.
B. Huang and K. Carley, “Parameterized convolutional neural networks for aspect level sentiment classification,” in Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, pp. 1091–1096.
IKIDID, A., El Fazziki, A., & Sadgal, M. (2022). A multi-agent Framework for dynamic traffic management Considering Priority Link. International Journal of Communication Networks and Information Security (IJCNIS), 13(2).
C. Fan, Q. Gao, J. Du, L. Gui, R. Xu, and K.-F. Wong, “Convolution- based memory network for aspect-based sentiment analysis,” in The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. ACM, 2018, pp. 1161–1164.
X. Li, L. Bing, W. Lam, and B. Shi, “Transformation networks for target- oriented sentiment classification,” in ACL, 2018, pp. 946–956.
W. Xue and T. Li, “Aspect based sentiment analysis with gated convo- lutional networks,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, 2018, pp. 2514–2523.
X. Li and W. Lam, “Deep multi-task learning for aspect term extraction with memory interaction,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017, pp. 2886– 2892
Sukhbaatar, Sainbayar, Jason Weston, and Rob Fergus. "End-to-end memory networks." Advances in neural information processing systems 28 (2015).
Chen, Peng, Zhongqian Sun, Lidong Bing, and Wei Yang. "Recurrent attention network on memory for aspect sentiment analysis." In Proceedings of the 2017 conference on empirical methods in natural language processing, pp. 452-461. 2017.
Li, Zheng, Ying Wei, Yu Zhang, Xiang Zhang, and Xin Li. "Exploiting coarse-to-fine task transfer for aspect-level sentiment classification." In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 4253-4260. 2019.
S. L. Bangare, “Classification of optimal brain tissue using dynamic region growing and fuzzy min-max neural network in brain magnetic resonance images”, Neuroscience Informatics, Volume 2, Issue 3, September 2022, 100019, ISSN 2772-5286, https://doi.org/10.1016/j.neuri.2021.100019.
S. L. Bangare, G. Pradeepini, S. T. Patil, “Implementation for brain tumor detection and three dimensional visualization model development for reconstruction”, ARPN Journal of Engineering and Applied Sciences (ARPN JEAS), Vol.13, Issue.2, ISSN 1819-6608, pp.467-473. 20/1/2018 http://www.arpnjournals.org/jeas/research_papers/rp_2018/jeas_0118_6691.pdf
Sandeep Pande and Manna Sheela Rani Chetty, “Bezier Curve Based Medicinal Leaf Classification using Capsule Network”, International Journal of Advanced Trends in Computer Science and Engineering, Vol. 8, No. 6, pp. 2735-2742, 2019.
Pande S.D., Chetty M.S.R. (2021) Fast Medicinal Leaf Retrieval Using CapsNet. In: Bhattacharyya S., Nayak J., Prakash K.B., Naik B., Abraham A. (eds) International Conference on Intelligent and Smart Computing in Data Analytics. Advances in Intelligent Systems and Computing, vol 1312.
Demirci, I., & Saritas, I. (2021). Damage Detection of Carbon Face Sheet Nomex Sandwich Composites with Image Processing Technique. International Journal of Intelligent Systems and Applications in Engineering, 9(4), 282–287. https://doi.org/10.18201/ijisae.2021474023
P. S. Bangare, S. L. Bangare, R. U. Yawle and S. T. Patil, "Detection of human feature in abandoned object with modern security alert system using Android Application," 2017 International Conference on Emerging Trends & Innovation in ICT (ICEI), 2017, pp. 139-144, doi: 10.1109/ETIICT.2017.7977025
N. Shelke, S. Chaudhury, S. Chakrabarti, S. L. Bangare et al. “An efficient way of text-based emotion analysis from social media using LRA-DNN”, Neuroscience Informatics, Volume 2, Issue 3, September 2022, 100048, ISSN 2772-5286, https://doi.org/10.1016/j.neuri.2022.100048.
Sehirli, E., & Turan, M. K. (2021). A Novel Method for Segmentation of QRS Complex on ECG Signals and Classify Cardiovascular Diseases via a Hybrid Model Based on Machine Learning. International Journal of Intelligent Systems and Applications in Engineering, 9(1), 12–21. https://doi.org/10.18201/ijisae.2021167932
Suneet Gupta, Sumit Kumar, Sunil L. Bangare, Shibili Nuhmani, Arnold C. Alguno, Issah Abubakari Samori, “Homogeneous Decision Community Extraction Based on End-User Mental Behavior on Social Media”, Computational Intelligence and Neuroscience, vol. 2022, Article ID 3490860, 9 pages, 2022. https://doi.org/10.1155/2022/3490860.
Gururaj Awate, S. L. Bangare, G. Pradeepini and S. T. Patil, “Detection of Alzheimers Disease from MRI using Convolutional Neural Network with Tensorflow”,arXiv, https://doi.org/10.48550/arXiv.1806.10170