Sarcasm Detection on Text for Political Domain— An Explainable Approach
Article Sidebar
Main Article Content
Abstract
In the era of social media, a large volume of data is generated by applications such as the industrial internet of things, IoT, Facebook, Twitter, and individual usage. Artificial intelligence and big data tools plays an important role in devising mechanisms for handling this vast volume of data as per the required usage of data to form important information from this unstructured data. When the data is publicly available on the internet and social media, it is imperative to treat the data carefully to respect the sentiments of the individuals. In this paper, the authors have attempted to solve three problems for treating the data using AI and data science tools, weighted statistical methods, and explainability of sarcastic comments. The first objective of this research study is sarcasm detection, and the next objective is to apply it to a domain-specific political Reddit dataset. Moreover, the last is to predict sarcastic words using counterfactual explainability. The textare extracted from the self-annotated Reddit corpus dataset containing 533 million comments written in English language, where 1.3 million comments are sarcastic. The sarcasm detection based model uses a weighted average approach and deep learning models to extract information and provide the required output in terms of content classification. Identifying sarcasm from a sentence is very challenging when the sentence has content that flips the polarity of positive sentiment into negative sentiment. This cumbersome task can be achieved with artificial intelligenceand machine learningalgorithms that train the machine and assist in classifying the required content from the sentences to keep the social media posts acceptable to society. There should be a mechanism to determine the extent to which the model's prediction could be relied upon. Therefore, the explination of the prediction is essential. We studied the methods and developed a model for detecting sarcasm and explaining the prediction. Therefore, the sarcasm detection model with explainability assists in identifying the sarcasmfrom the reddit post and its sentiment score to classify given textcorrectly. The F1-score of 75.75% for sarcasm and 80% for the explainability model proves the robustness of the proposed model.
Article Details
References
Singh, P. D.; Kaur, R.; Singh, K. D.; Dhiman, G. A Novel Ensemble-Based Classifier for Detecting the COVID-19 Disease for Infected Patients. Inf. Syst. Front. 2021, 23 (6), 1385–1401. https://doi.org/10.1007/s10796-021-10132-w.
Kalaivani; Thenmozhi. Sarcasm Identification and Detection in Conversion Context Using BERT. In Proceedings of the Second Workshop on Figurative Language Processing; Association for Computational Linguistics: Stroudsburg, PA, USA, 2020.
Gupta, R. K.; Yang, Y. CrystalNest at SemEval-2017 Task 4: Using Sarcasm Detection for Enhancing Sentiment Classification and Quantification. In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017); Association for Computational Linguistics: Stroudsburg, PA, USA, 2017.
Kumar, A.; Dikshit, S.; Albuquerque, V. H. C. Explainable Artificial Intelligence for Sarcasm Detection in Dialogues. Wirel. Commun. Mob. Comput. 2021, 2021, 1–13. https://doi.org/10.1155/2021/2939334.
Kumar, A.; Sangwan, S. R.; Singh, A. K.; Wadhwa, G. Hybrid Deep Learning Model for Sarcasm Detection in Indian Indigenous Language Using Word-Emoji Embeddings. Transactions on Asian and Low-Resource Language Information Processing; 2022.
Parmar, K.; Limbasiya, N.; Dhamecha, M. Feature Based Composite Approach for Sarcasm Detection Using MapReduce. In 2018 Second International Conference on Computing Methodologies and Communication (ICCMC); IEEE, 2018.
Cai, Y.; Cai, H.; Wan, X. Multi-Modal Sarcasm Detection in Twitter with Hierarchical Fusion Model. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics; 2019; pp 2506–2515.
Baziotis, C.; Nikolaos, A.; Papalampidi, P.; Kolovou, A.; Paraskevopoulos, G.; Ellinas, N.; Potamianos, A. NTUA-SLP at SemEval-2018 Task 3: Tracking Ironic Tweets Using Ensembles of Word and Character Level Attentive RNNs. In Proceedings of The 12th International Workshop on Semantic Evaluation; Association for Computational Linguistics: Stroudsburg, PA, USA, 2018.
Sarsam, S. M.; Al-Samarraie, H.; Alzahrani, A. I.; Wright, B. Sarcasm Detection Using Machine Learning Algorithms in Twitter: A Systematic Review. Int. J. Mark. Res. 2020, 62 (5), 578–598. https://doi.org/10.1177/1470785320921779.
Razali, M. S.; Halin, A. A.; Ye, L.; Doraisamy, S.; Norowi, N. M. Sarcasm Detection Using Deep Learning with Contextual Features. IEEE Access 2021, 9, 68609–68618. https://doi.org/10.1109/access.2021.3076789.
Sarsam, S.M., Al-Samarraie, H., Alzahrani, A.I., Alnumay, W. and Smith, A.P., 2021. A lexicon-based approach to detecting suicide-related messages on Twitter. Biomedical Signal Processing and Control, 65, p.102355.
Buschmeier, K.; Cimiano, P.; Klinger, R. An Impact Analysis of Features in a Classification Approach to Irony Detection in Product Reviews. In Proceedings of the 5th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis; Association for Computational Linguistics: Stroudsburg, PA, USA, 2014.
Joshi, A.; Tripathi, V.; Patel, K.; Bhattacharyya, P.; Carman, M. Are Word Embedding-Based Features Useful for Sarcasm Detection? In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing; Association for Computational Linguistics: Stroudsburg, PA, USA, 2016.
Poria, S.; Cambria, E.; Hazarika, D.; Vij, P. A Deeper Look into Sarcastic Tweets Using Deep Convolutional Neural Networks. arXiv [cs.CL], 2016.
Bamman, D.; Smith, N. Contextualized Sarcasm Detection on Twitter. Proceedings of the International AAAI Conference on Web and Social Media 2015, 9.
Suhaimin, M. S. M.; Hijazi, M. H. A.; Alfred, R.; Coenen, F. Natural Language Processing Based Features for Sarcasm Detection: An Investigation Using Bilingual Social Media Texts. In 2017 8th International Conference on Information Technology (ICIT); IEEE, 2017.
Jacovi, A.; Sar Shalom, O.; Goldberg, Y. Understanding Convolutional Neural Networks for Text Classification. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP; Association for Computational Linguistics: Stroudsburg, PA, USA, 2018.
Bodria, F.; Panisson, A.; Perotti, A.; Piaggesi, S. Explainability Methods for Natural Language Processing: Applications to Sentiment Analysis; 2020.
Messalas, A.; Kanellopoulos, Y.; Makris, C. Model-Agnostic Interpretability with Shapley Values. In 2019 10th International Conference on Information, Intelligence, Systems and Applications (IISA); IEEE, 2019.
Fiok, K.; Karwowski, W.; Gutierrez, E.; Ahram, T. Predicting the Volume of Response to Tweets Posted by a Single Twitter Account. Symmetry (Basel) 2020, 12 (6), 1054. https://doi.org/10.3390/sym12061054.
Malolan, B.; Parekh, A.; Kazi, F. Explainable Deep-Fake Detection Using Visual Interpretability Methods. In 2020 3rd International Conference on Information and Computer Technologies (ICICT); IEEE, 2020.
Yang, L.; Kenny, E.; Ng, T. L. J.; Yang, Y.; Smyth, B.; Dong, R. Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classification. In Proceedings of the 28th International Conference on Computational Linguistics; International Committee on Computational Linguistics: Stroudsburg, PA, USA, 2020.
Bagate, R. A.; Suguna, R. Different Approaches in Sarcasm Detection: A Survey. In Intelligent Data Communication Technologies and Internet of Things; Springer International Publishing: Cham, 2020; pp 425–433.
Tay, Y.; Luu, A. T.; Hui, S. C.; Su, J. Reasoning with Sarcasm by Reading In-Between. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers); Association for Computational Linguistics: Stroudsburg, PA, USA, 2018.
Riloff, E.; Qadir, A.; Surve, P.; De Silva, L.; Gilbert, N.; Huang, R. Sarcasm as Contrast between a Positive Sentiment and Negative Situation. In Proceedings of the 2013 conference on empirical methods in natural language processing; 2013; pp 704–714.
Ghosh, A.; Veale, T. Magnets for Sarcasm: Making Sarcasm Detection Timely, Contextual and Very Personal. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing; Association for Computational Linguistics: Stroudsburg, PA, USA, 2017.
Khodak, M.; Saunshi, N.; Vodrahalli, K. A Large Self-Annotated Corpus for Sarcasm. arXiv [cs.CL], 2017.
Bagate, R. A.; Suguna, R. Sarcasm Detection of Tweets without #sarcasm: Data Science Approach. Indones. j. electr. eng.comput. sci. 2021, 23 (2), 993. https://doi.org/10.11591/ijeecs.v23.i2.pp993-1001.
Dhar, S.; Bose, I. Emotions in Twitter Communication and Stock Prices of Firms: The Impact of Covid-19 Pandemic. Decision 2020, 47 (4), 385–399. https://doi.org/10.1007/s40622-020-00264-4.
Hutto, C.; Gilbert, E. Vader: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text. Proceedings of the international AAAI conference on web and social media 2014, 8, 216–225.
Luintel, S.; Sah, R. K.; Lamichhane, B. R. A Hybrid Approach for Sarcasm Detection. Tech J 2019, 1 (1), 1–9. https://doi.org/10.3126/tj.v1i1.27581.
Bagate, R., & Suguna, R. (2022). Sarcasm Detection on Tweets: Ensemble Approach. International Journal of Next-Generation Computing, 13(3).
Liebrecht, C. C.; Kunneman, F. A.; Bosch, A. P. J. The Perfect Solution for Detecting Sarcasm in Tweets# Not; 2013.
González-Ibánez, R.; Muresan, S.; Wacholder, N. Identifying Sarcasm in Twitter: A Closer Look. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies; 2011; pp 581–586.
Karoui, Jihen, Farah Benamara, VéroniqueMoriceau, Viviana Patti, Cristina Bosco, and Nathalie Aussenac-Gilles. "Exploring the impact of pragmatic phenomena on irony detection in tweets: A multilingual corpus study." In 15th Conference of the European Chapter of the Association for Computational Linguistics, vol. 1, pp. 262-272. 2017.
Sable Nilesh Popat*, Y. P. Singh,” Efficient Research on the Relationship Standard Mining Calculations in Data Mining” in Journal of Advances in Science and Technology | Science & Technology, Vol. 14, Issue No. 2, September-2017, ISSN 2230-9659.
Sable Nilesh Popat*, Y. P. Singh,” Analysis and Study on the Classifier Based Data Mining Methods” in Journal of Advances in Science and Technology | Science & Technology, Vol. 14, Issue No. 2, September-2017, ISSN 2230-9659.