Aspect-Based Sentiment Analysis using Machine Learning and Deep Learning Approaches
Main Article Content
Sentiment analysis (SA) is also known as opinion mining, it is the process of gathering and analyzing people's opinions about a particular service, good, or company on websites like Twitter, Facebook, Instagram, LinkedIn, and blogs, among other places. This article covers a thorough analysis of SA and its levels. This manuscript's main focus is on aspect-based SA, which helps manufacturing organizations make better decisions by examining consumers' viewpoints and opinions of their products. The many approaches and methods used in aspect-based sentiment analysis are covered in this review study (ABSA). The features associated with the aspects were manually drawn out in traditional methods, which made it a time-consuming and error-prone operation. Nevertheless, these restrictions may be overcome as artificial intelligence develops. Therefore, to increase the effectiveness of ABSA, researchers are increasingly using AI-based machine learning (ML) and deep learning (DL) techniques. Additionally, certain recently released ABSA approaches based on ML and DL are examined, contrasted, and based on this research, gaps in both methodologies are discovered. At the conclusion of this study, the difficulties that current ABSA models encounter are also emphasized, along with suggestions that can be made to improve the efficacy and precision of ABSA systems.
T. A. Rana, and Y. N. Cheah, “Aspect extraction in sentiment analysis: comparative analysis and survey”. Arti. Intelli. Rev. vol. 46, no. 4, pp. 459–483, 2016.
A. Mohammadi, and A. Shaverizade. "Ensemble deep learning for aspect-based sentiment analysis." Inter. J. Nonlinear A. App., vol 12, pp. 29-38, 2021.
J. Zhao, K. Liu, and L. Xu, “Sentiment analysis: mining opinions, sentiments, and emotions,” Cambridge University Press, 2016.
F.A. Pozzi, E. Fersini, E. Messina, and B. Liu, “Challenges of sentiment analysis in social networks: an overview,” Editors (s): Sentiment analysis in social networks. Morgan Kaufmann, Burlington, 2017, pp 1–11, https://doi.org/10.1016/B978-0-12-804412-4.00001-2.
B. N. Rodrigues Chagas, J. A. Nogueira Viana, O. Reinhold, F. Lobato, A. F. L. Jacob and R. Alt, "Current Applications of Machine Learning Techniques in CRM: A Literature Review and Practical Implications," 2018 IEEE/WIC/ACM International Conference on Web Intelligence (WI), 2018, pp. 452-458, doi: 10.1109/WI.2018.00-53.
T. Gupta, and S. Chauhan. "Aspect-base Sentiment Analysis", Viveka. J. Res. vol. 10, 2021, pp. 35-41.
C. Yao, X. Song, X. Zhang, W. Zhao, and A. Feng, "Multitask Learning for Aspect-Based Senti-ment Classification," Sci. Prog., vol. 2021, pp.1-9, 2021, https://doi.org/10.1155/2021/2055555.
R. Arulmurugan, K. Sabarmathi, and H. Anandakumar, “Classification of sentence level sentiment analysis using cloud machine learning techniques,” Clust. Comput. vol. 22, no. 1, 2019, pp. 1199–1209.
V.S. Shirsat, R.S. Jagdale, and S.N. Deshmukh, “Sentence level sentiment identification and calculation from news articles using machine learning techniques,” In: Computing, communication and signal processing, Springer, 2019, pp 371–376.
T. Brychcín, M. Konkol, and J. Steinberger, “UWB: Machine Learning Approach to Aspect-Based Sentiment Analysis.” Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), 2014, Doi:10.3115/v1/S14-2145.
L. Jiang, M. Yu, M. Zhou, X. Liu, and T. Zhao, “Target-dependent Twitter sentiment classification,” In Proceeding of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (Association for Computational Linguistics) Portland, Oregon, USA, jun. 2011, pp. 51–160.
Y. Wang, M. Huang, X. Zhu, and L. Zhao, "Attention-based LSTM for aspect-level sentiment classification", Proc. Conf. Empirical Methods Natural Lang. Process., 2016, pp. 606-615.
W. Wang, S.J. Pan, D. Dahlmeier, and X. Xiao, "Recursive Neural Conditional Random Fields for Aspect-Based Sentiment Analysis," Proc. 2016 Conf, Empirical Methods in Natural Language Processing, 2016, pp. 616–626.
Y. Ma, H. Peng, T. Khan, E. Cambria, and A. Hussain, "Sentic LSTM: A Hybrid Network for Targeted Aspect-Based Sentiment Analysis," Cognitive Computation, vol. 10, no. 4, 2018, pp. 639-650.
H. Luo, T. Li, B. Liu, B. Wang, and H. Unger, "Improving Aspect Term Extraction with Bidirectional Dependency Tree Representation," arXiv Preprint arXiv:1805.07889, 2019, p. 12.
H. Li, and W. Lu, "Learning Latent Sentiment Scopes for Entity-Level Sentiment Analysis," Proc. 31st AAAI Conf. Artificial Intelligence, 2017, pp. 3482-3489.
J. Yang, R. Yang, C. Wang, and J. Xie, "Multi-Entity Aspect-Based Sentiment Analysis with Context, Entity and Aspect Memory," Proc. 32nd AAAI Conf. Artificial Intelligence, 2018, pp. 6029-6036.
Y. Tay, A.T. Luu, and S.C. Hui, "Learning to Attend via Word-Aspect Associative Fusion for Aspect-based Sentiment Analysis," Proc. 32nd AAAI Conf. Artificial Intelligence, 2017, pp. 5956-5963.
J. Wang, J. Li, S. Li, Y. Kang, M. Zhang, L. Si, and G. Zhou, “Aspect Sentiment Classification with both Word-level and Clause-level Attention Networks," Proc. 27th Int’l Joint Conf. Artificial Intelligence, 2018, pp. 4439-4445, https://doi.org/10.24963/ijcai.2018/617.
C.G.Q. Chi, Z. Ouyang, and X. Xu, "Changing Perceptions and Reasoning Process: Comparison of Residents’ Pre- and Post-Event Attitudes," Annals of Tourism Research, vol. 70, 2018, pp. 39-53.
H.Y. Chen, and H. H. Chen, “Implicit polarity and implicit aspect recognition in opinion mining,” 2016, pp. 20–25.
S. Poria, E. Cambria, and A. Gelbukh, “Aspect extraction for opinion mining with a deep convolutional neural network,” Know. Based Sys.” vol. 108, 2016, pp. 42–49. doi: https://doi.org/10.1016/j.knosys.2016.06.009.
Z. Nasim, and S. Haider, "ABSA Toolkit: An Open-Source Tool for Aspect Based Sentiment Analysis," Int. J. Arti. Intelli. T., vol. 26, 2017, pp. 1-31.
C. Gupta, A. Jain, and N. Joshi, "A Novel Approach to feature hierarchy in Aspect Based Sentiment Analysis using OWA operator," in Proceedings of 2nd International Conference on Communication, Comp. Net., 2019, pp. 661- 667.
M. Ahmed, Q. Chen, Y. Wang, and Z. Li, "Hint-Embedding Attention-Based LSTM for Aspect Identification Sentiment Analysis," in Pacific Rim International Conference on Artificial Intelligence, 2019, pp. 569-581.
Y. Ding, C. Yu, and J. Jiang, "A neural network model for semi-supervised review aspect identification," in Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2017, pp. 668-680.
R. He, W. S. Lee, H. T. Ng, and D. Dahlmeier, "An unsupervised neural attention model for aspect extraction," in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, vol. 1, Long Papers, 2017, pp. 388-397.
B. Kama, M. Ozturk, P. Karagoz, I. H. Toroslu, and M. Kalender, "Analyzing Implicit Aspects and Aspect Dependent Sentiment Polarity for Aspect-based Sentiment Analysis on Informal Turkish Texts," in Proceedings of the 9th International Conference on Management of Digital EcoSystems, 2017, pp. 134-141.
M. Tubishat, and N. Idris, "Explicit and implicit aspect extraction using whale optimization algorithm and hybrid approach," In 2018 International Conference on Industrial Enterprise and System Engineering (ICoIESE 2018), 2019.
R. Klinger, and P. Cimiano, "Joint and pipeline probabilistic models for fine-grained sentiment analysis: Extracting aspects, subjective phrases and their relations," in Data Mining Workshops (ICDMW), 2013 IEEE 13th International Conference on, 2013, pp. 937-944.
R. K. Amplayo, S. Lee, and M. Song, "Incorporating product description to sentiment topic models for improved aspect-based sentiment analysis," Information Sciences, vol. 454, 2018, pp. 200-215.
S. Khalid, M. H. Aslam, and M. T. Khan, "Opinion Reason Mining: Implicit Aspects beyond Implying aspects," in 2018 21st Saudi Computer Society National Computer Conference (NCC), 2018, pp. 1-5.
N. Zainuddin, A. Selamat, and R. Ibrahim, "Hybrid sentiment classification on twitter aspect-based sentiment analysis," Appl. Intelli., vol. 48, 2018, pp. 1218-1232.
A. Mukherjee, and B. Liu, “Aspect extraction through semi-supervised modelling.” In Proceedings of the 50 Annual Meeting of the Association for Computational Linguistics (Association for Computational Linguistics) Jeju Island, Korea, Jul. 2012, pp. 339–348.
W. Xue, “MTNA: A neural multi-task model for aspect category classification and aspect term extraction on restaurant reviews.” Proceedings of the 8th International Joint Conference on Natural Language Processing, Taipei, Taiwan, 2017, pp. 151–156.
D. Tang, B. Qin, X. Feng, and T. Liu, “Effective LSTMs for target-dependent sentiment classification,” 26th International Conference on Computational Linguistics, Proceedings of COLING 2016: Technical Papers, Osaka, Japan, dec. 2016, pp. 3298-3307.
A. Go, R. Bhayani, and L. Huang, “Twitter sentiment classification using distant supervision,” CS224N Project Report, Stanford, vol. 1, 2009, p.12.
M. Pontiki, D. Galanis, J. Pavlopoulos, H. Papageorgiou, I. Androutsopoulos, and S. Manandhar, SemEval-2014 Task 4: Aspect Based Sentiment Analysis. In Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), 2014, pages 27–35, Dublin, Ireland. Association for Computational Linguistics. doi:10.3115/v1/S14-2004.
L. Wang, C. Yao, X. Li, and X. Yu, "BERT-based implicit aspect extraction," IEEE 3rd International Conference on Civil Aviation Safety and Information Technology (ICCASIT), 2021, pp. 758-761, doi: 10.1109/ICCASIT53235.2021.9633578.
K. Sattar, Q. Umer, D. G. Vasbieva, S. Chung, Z. Latif, and C. Lee, "A Multi-Layer Network for Aspect-Based Cross-Lingual Sentiment Classification," in IEEE Access, vol. 9, pp. 133961-133973, 2021, doi: 10.1109/ACCESS.2021.3116053.
M.S. Neethu, and R. Rajasree, "Sentiment Analysis in Twitter using Machine Learning Techniques", 4th ICCCNT Tiruchengode, India, IEEE, jul. 2013, pp. 4 - 6.
R. Xia, F. Xu, C. Zong, Q. Li, Y. Qi, and T. Li, "Dual Sentiment Analysis: Considering Two Sides of One Review," IEEE Trans. Knowl. Data Eng., 2015.
R. S. Ramanujam, R. Nancyamala, J. Nivedha, and J. Kokila, "Sentiment analysis using big data," 2015 International Conference on Computation of Power, Energy, Information and Communication (ICCPEIC), 2015, pp. 0480-0484, doi: 10.1109/ICCPEIC.2015.7259528.
M. Bouazizi, and T. Ohtsuki, "A Pattern-Based Approach for Sarcasm Detection on Twitter", IEEE Trans. Knowl. Data Eng., vol. 4, pp. 5477-5488, 2016, doi: 10.1109/ACCESS.2016.2594194.
G. Gautam, and D. Yadav, “Sentiment analysis of twitter data using machine learning approaches and semantic analysis.” Seventh International Conference on Contemporary Computing (IC3), 2014.
S. Bahrainian, and A. Dengel, “Sentiment Analysis and Summarization of Twitter Data.” IEEE 16th International Conference on Computational Science and Engineering, 2013.
A. Agarwal, B. Xie, I. Vovsha, O. Rambow, and R.J. Passonneau, “Sentiment analysis of twitter data.” In Proceedings of the workshop on language in social media (LSM 2011),” jun. 2011, pp. 30-38.
D. Gurkhe, N. Pal, and B. Rishit. "Effective Sentiment Analysis of Social Media Datasets using Naïve Bayesian Classification," Int. J. Comput. Appl., vol. 99, no. 13, aug. 2014.
L. Jiang, M. Yu, M. Zhou, X. Liu, and T. Zhao. “Target-dependent Twitter Sentiment Classification,” In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, Oregon, USA. Association for Computational Linguistics, 2011, pp. 151–160.
X. Ding, B. Liu, and P.S. Yu, “A holistic lexicon-based approach to opinion mining”, Proceedings of the 2008 International Conference on Web Search and Data Mining, California, USA, 2008, pp. 231–39.
X. Zhao, J. Jiang, H. Yan, and X. Li, “Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid,” Proceeding of the 2010 Conference on Empirical Methods in Natural Language Processing, Cambridge, MA (Association for Computational Linguistics), oct. 2010, pp. 56–65.
A. Nazir, Y. Rao, L. Wu, and L. Sun, “Issues and challenges of aspect-based sentiment analysis: a comprehensive survey,” IEEE Trans. Affect. Com, 2020, doi:10.1109/TAFFC.2020.2970399.
T. A. Rana, and Y.N Cheah, "Hybrid rule-based approach for aspect extraction and categorization from customer reviews," 9th International Conference on IT in Asia (CITA), 2015, pp. 1-5, doi: 10.1109/CITA.2015.7349820.
M. Tubishat, N. Idris, and M. Abushariah, "Explicit aspects extraction in sentiment analysis using optimal rules combination," Future Gener. Comput. Syst., vol. 114, 2021, pp. 448-480, doi: 10.1016/j.future.2020.08.019.
S.M. Jiménez-Zafra, M. T. Martín-Valdivia, E. Martínez-Cámara, and L.A. Ureña-López, “Combining resources to improve unsupervised sentiment analysis at aspect-level,” J. Info. Sci., vol. 42, no.2, 2016, pp.213-229.
M. H. Krishna, K. Rahamathulla, and A. Akbar, "A feature-based approach for sentiment analysis using SVM and coreference resolution," 2017 International Conference on Inventive Communication and Computational Technologies (ICICCT), 2017, pp. 397-399, doi: 10.1109/ICICCT.2017.7975227.
M. AL-Smadi, M. Al-Ayyoub, H. Al-Sarhan, and Y. Jararweh, “An Aspect-Based Sentiment Analysis Approach to Evaluating Arabic News Affect on Readers,” J. UNI. COMP. SCI., vol. 22, 2016, pp. 630-649.
H. Xu, F. Zhang, and W. Wang. “Implicit feature identification in Chinese reviews using explicit topic mining model,” Know. Based Syst. vol. 76, no. 1, mar. 2015, pp. 166–175. doi: https://doi.org/10.1016/j.knosys.2014.12.012.
H. E. Hannach, and M. Benkhalifa, "WordNet based Implicit Aspect Sentiment Analysis for Crime Identification from Twitter,” Int. J. Adv. Comput. Sci. Appl. vol. 9, 2018.
R. Hegde, and S. Seema, "Aspect based feature extraction and sentiment classification of review data sets using Incremental machine learning algorithm," Third International Conference on Advances in Electrical, Electronics, Information, Communication and Bio-Informatics (AEEICB), 2017, pp. 122-125, doi: 10.1109/AEEICB.2017.7972395.
M. AL-Smadi, O. Qwasmeh, B. Talafha, M. Al-Ayyoub, Y. Jararweh, and E. Benkhelifa, "An enhanced framework for aspect-based sentiment analysis of Hotels' reviews: Arabic reviews case study," 2016 11th International Conference for Internet Technology and Secured Transactions (ICITST), 2016, pp. 98-103, doi: 10.1109/ICITST.2016.7856675.
M. Tubishat, and N. Idris, "Explicit and implicit aspect extraction using whale optimization algorithm and hybrid approach." Proc. Int. Conf. Ind. Enterprise Syst. Eng. (ICoIESE), 2019.
W. Maharani, D. H. Widyantoro, and M.L. Khodra. "Aspect extraction in customer reviews using syntactic pattern." Procedia Computer Science, vol. 59, 2015, pp. 244-253.
T.A. Rana, Y.N, Cheah, and T. Rana, “Multi-level knowledge-based approach for implicit aspect identification,” Appl. Intell. vol. 50, 2020, pp. 4616–4630 2020, doi:10.1007/s10489-020-01817-x.
B.R. Bhamare, and J. Prabhu, "A supervised scheme for aspect extraction in sentiment analysis using the hybrid feature set of word dependency relations and lemmas." Peer J Computer Science, vol. 7, 2021, pp. e347, https://doi.org/10.7717/peerj-cs.347.
M. Afzaal, M. Usman, A.C. Fong, and S. Fong, “Multiaspect?based opinion classification model for tourist reviews,” Exp. Sys., vol. 36, no. 2, 2019, pp. e12371, doi:10.1111/exsy.12371.
W. Paik, S. Yilmazel, E. Brown, M. Poulin, S. Dubon, and C. Amice. “Applying natural language processing (NLP) based metadata extraction to automatically acquire user preferences,” In Proceedings of the 1st international conference on Knowledge capture (K-CAP '01). Association for Computing Machinery, New York, NY, USA, 2001, pp. 116–122. doi: 10.1145/500737.500757.
W. Maharani, D. H. Widyantoro, and M. L. Khodra, "SAE: Syntactic-based aspect and opinion extraction from product reviews," 2nd International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA), 2015, pp. 1-6, doi: 10.1109/ICAICTA.2015.7335371.
M. Afzaal, M. Usman, A. Fong, “Predictive aspect-based sentiment classification of online tourist reviews,” J. Info. Sci., vol. 45, no.3, 2019, pp. 341-363.
S. Ahmed, S. Hina, E. Atwell, and F Ahmed, "Aspect based sentiment analysis framework using data from social media network," Int. J. Comp. Sci. Net. Sec., vol. 17, no. 7, 2017, pp. 100-105.
T. Hercig, T. Brychcín, L. Svoboda, M. Konkol, and J. Steinberger, "Unsupervised methods to improve aspect-based sentiment analysis in Czech," Computación y Sistemas, vol. 20, no. 3, 2016, pp. 365-375.
B. Kane, A. Jrad, A. Essebbar, O. Guinaudeau, V. Chiesa, I. Qu´enel, and S. Chau, "CNN-LSTM-CRF for Aspect-Based Sentiment Analysis: A Joint Method Applied to French Reviews," ICAART vol. 1, 2021.
X. Wang, M. Tang, T. Yang, and Z. Wang, "A novel network with multiple attention mechanisms for aspect-level sentiment analysis," Knowl Based Syst, vol. 227, 2021, doi: https://doi.org/10.1016/j.knosys.2021.107196 .
G. Cai, and H. Li, “Joint attention LSTM network for aspect-level sentiment analysis. In China Conference on Information Retreival,” Guilin, China: Springer International Publishing, 2018, pp. 147–57, doi: 10.1007/978-3-030-01012-6_12.
A. Mohammadi, and A. Shaverizade, “Ensemble deep learning for aspect-based sentiment analysis,” Inter. J. Nonlin. Ana. Appl., vol. 12, 2021, pp. 29-38, doi: 10.22075/IJNAA.2021.4769.
S. Dhabekar, and M. D. Patil. "Implementation of Deep Learning Based Sentiment Classification and Product Aspect Analysis," ITM Web of Conferences, vol. 40, EDP Sciences, 2021.
J. Shobana, and M. Murali, “An efficient sentiment analysis methodology based on long short-term memory networks,” Complex Intell. Syst. vol. 7, pp. 2485–2501, 2021, https://doi.org/10.1007/s40747-021-00436-4.
V. Gupta, N. Jain, S. Shubham, A. Madan, A. Chaudhary, and Q. Xin, “Toward Integrated CNN-based Sentiment Analysis of Tweets for Scarce-resource Language Hindi,” ACM Trans. Asian Low-Resour. Lang. Inf. Process, vol 20, no. 5, Article 80, sep. 2021, pp. 1-23, doi: https://doi.org/10.1145/3450447.
S. Yang, L. Xing,Y. Li, and Z. Chang, "Implicit sentiment analysis based on graph attention neural network," Engineering Reports,” vol. 4, no. 1, 2022, pp. e12452, doi: https://doi.org/10.1002/eng2.12452.
M. Hussein, and F. Özyurt. "A New Technique for Sentiment Analysis System Based on Deep Learning Using Chi-Square Feature Selection Methods." Balkan Journal of Electrical and Computer Engineering, vol. 9, no. 4, 2021, pp. 320-326, doi: 10.17694/bajece.887339.
D. Tiwari, and B. Nagpal. "Enhanced Long Short-Term Memory (ELSTM) Model for Sentiment Analysis," Int. Arab. J. Inf. Technol., vol. 18, no.6, 2021, pp. 846-855, doi: https://doi.org/10.34028/iajit/18/6/12.
A. Masmoudi, H. Jamila, and L.H. Belguith, "Deep Learning for Sentiment Analysis of Tunisian Dialect." Computación y Sistemas, vol. 25, no. 1, 2021, pp. 129-148, doi: https://doi.org/10.13053/CyS-25-1-3472.
H. Li, Y. Ma, Z. Ma, and H. Zhu, "Weibo Text Sentiment Analysis Based on BERT and Deep Learning," Appl. Sci., vol. 11, no. 22, 2021, pp. 10774, doi: https://doi.org/10.3390/app112210774.
T. A. Rana, and Y. N. Cheah. "A two-fold rule-based model for aspect extraction," Expert systems with applications, vol. 89, 2017, pp. 273-285, doi: https://doi.org/10.1016/j.eswa.2017.07.047.
A.R. Pathak, M. Pandey, and S. Rautaray, "Adaptive model for dynamic and temporal topic modeling from big data using deep learning architecture." Int. J. Intell. Syst. App., vol. 11, no. 6, 2019, pp. 13-27, doi:10.5815/ijisa.2019.06.02.
M. M. Abdelgwad, T. H. A. Soliman, A.I. Taloba, and M. F. Farghaly, “Arabic aspect-based sentiment analysis using bidirectional GRU based models,” J. King Saud Univ. - Comput. Inf. Sci., vol. 8, 2021, https://doi.org/10.1016/j.jksuci.2021.08.030.
S. Datta, S. Chakrabarti, “Aspect based sentiment analysis for demonetization tweets by optimized recurrent neural network using fire fly-oriented multi-verse optimizer,” S?dhan?, vol. 46, no. 79, 2021. https://doi.org/10.1007/s12046-021-01608-1.
S. Gu, L. Zhang, Y. Huo, Y. Song, “A position-aware bidirectional attention network for aspect-level sentiment analysis,” Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, New Mexico, aug. 2018, USA. pp.774–784.
L. Li, Y. Liu, and A. Zhou, “Hierarchical attention-based position-aware network for aspect-level sentiment analysis,” Conference of Computational Natural Language Learning (CoNLL), Brussels, Belgium, Association for Computational Linguistics, 2018, pp. 181–189.
M. Mhamed, R. Sutcliffe, X. Sun, J. Feng, E. Almekhlafi, E. A. Retta, "Improving Arabic Sentiment Analysis Using CNN-Based Architectures and Text Pre-processing," Comput. Intell. Neurosci., vol. 2021, 2021, pp. 1-12.
L. Zhu, M. Xu, Y. Bao, Y. Xu, and X. Kong, “Deep learning for aspect-based sentiment analysis: a review. Peer J Computer Science,” vol. 8, no. e1044, 2022, pp. 1-37, https://doi.org/10.7717/peerj-cs.1044.