Cultivating Insight: Detecting Autism Spectrum Disorder through Residual Attention Network in Facial Image Analysis

Main Article Content

Gnanaprakasam C
Manoj Kumar Rajagopal
A. Swaminathan
L. M. Merlin Livingston
G. Ramkumar

Abstract

Revolutionizing Autism Spectrum Disorder Identification through Deep Learning: Unveiling Facial Activation Patterns. In this study, our primary objective is to harness the power of deep learning algorithms for the precise identification of individuals with autism spectrum disorder (ASD) solely from facial image datasets. Our investigation centers around the utilization of face activation patterns, aiming to uncover novel insights into the distinctive facial features of ASD patients. To accomplish this, we meticulously examined facial imaging data from a global and multidisciplinary repository known as the Autism Face Imaging Data Exchange. Autism spectrum disorder is characterized by inherent social deficits and manifests in a spectrum of diverse symptomatic scenarios. Recent data from the Centers for Disease Control (CDC) underscores the significance of this disorder, indicating that approximately 1 in 54 children are impacted by ASD, according to estimations from the CDC's Autism and Developmental Disabilities Monitoring Network (ADDM). Our research delved into the intricate functional connectivity patterns that objectively distinguish ASD participants, focusing on their facial imaging data. Through this investigation, we aimed to uncover the latent facial patterns that play a pivotal role in the classification of ASD cases. Our approach introduces a novel module that enhances the discriminative potential of standard convolutional neural networks (CNNs), such as ResNet-50, thus significantly advancing the state-of-the-art. Our model achieved an impressive accuracy rate of 99% in distinguishing between ASD patients and control subjects within the dataset. Our findings illuminate the specific facial expression domains that contribute most significantly to the differentiation of ASD cases from typically developing individuals, as inferred from our deep learning methodology. To validate our approach, we conducted real-time video testing on diverse children, achieving an outstanding accuracy score of 99.90% and an F1 score of 99.67%. Through this pioneering work, we not only offer a cutting-edge approach to ASD identification but also contribute to the understanding of the underlying facial activation patterns that hold potential for transforming the diagnostic landscape of autism spectrum disorder.

Article Details

How to Cite
C, G. ., Rajagopal, M. K. ., Swaminathan, A. ., Livingston, L. M. M. ., & Ramkumar, G. . (2023). Cultivating Insight: Detecting Autism Spectrum Disorder through Residual Attention Network in Facial Image Analysis. International Journal on Recent and Innovation Trends in Computing and Communication, 11(11s), 333–340. https://doi.org/10.17762/ijritcc.v11i11s.8160
Section
Articles

References

Hashemi, Jordan, Mariano Tepper, Thiago Vallin Spina, Amy Esler, Vassilios Morellas, Nikolaos Papanikolopoulos, Helen Egger, Geraldine Dawson, and Guillermo Sapiro. "Computer vision tools for low-cost and noninvasive measurement of autism-related behaviors in infants." Autism research and treatment 2014 (2014).

Smitha, Kavallur Gopi, and A. Prasad Vinod. "Facial emotion recognition system for autistic children: a feasible study based on FPGA implementation." Medical & biological engineering & computing 53, no. 11 (2015): 1221-1229.

Garman, Heather D., Christine J. Spaulding, Sara Jane Webb, Amori Yee Mikami, James P. Morris, and Matthew D. Lerner. "Wanting it Too Much: An Inverse Relation Between Social Motivation and Facial Emotion Recognition in Autism Spectrum Disorder." Child Psychiatry & Human Development 47, no. 6 (2016): 890-902.

McPartland, James C., Sara Jane Webb, Brandon Keehn, and Geraldine Dawson. "Patterns of visual attention to faces and objects in autism spectrum disorder." Journal of autism and developmental disorders 41, no. 2 (2011): 148-157.

Harms, Madeline B., Alex Martin, and Gregory L. Wallace. "Facial emotion recognition in autism spectrum disorders: a review of behavioral and neuroimaging studies." Neuropsychology review 20, no. 3 (2010): 290-322.

Wong, Nina, Deborah C. Beidel, Dustin E. Sarver, and Valerie Sims. "Facial emotion recognition in children with high functioning autism and children with social phobia." Child Psychiatry & Human Development 43, no. 5 (2012): 775-794.

Macdonald, Hope, Michael Rutter, Patricia Howlin, Patricia Rios, Ann Le Conteur, Christopher Evered, and Susan Folstein. "Recognition and expression of emotional cues by autistic and normal adults." Journal of Child Psychology and Psychiatry 30, no. 6 (1989): 865-877.

Humphreys, Kate, Nancy Minshew, Grace Lee Leonard, and Marlene Behrmann. "A fine-grained analysis of facial expression processing in high-functioning adults with autism." Neuropsychologia 45, no. 4 (2007): 685-695.

Rump, Keiran M., Joyce L. Giovannelli, Nancy J. Minshew, and Mark S. Strauss. "The development of emotion recognition in individuals with autism." Child development 80, no. 5 (2009): 1434-1447.

Smith, Miriam J. Law, Barbara Montagne, David I. Perrett, Michael Gill, and Louise Gallagher. "Detecting subtle facial emotion recognition deficits in high-functioning autism using dynamic stimuli of varying intensities." Neuropsychologia 48, no. 9 (2010): 2777-2781.

Sucksmith, E., C. Allison, S. Baron-Cohen, B. Chakrabarti, and R. A. Hoekstra. "Empathy and emotion recognition in people with autism, first-degree relatives, and controls." Neuropsychologia 51, no. 1 (2013): 98-105.

Chandler, Susie, Patricia Howlin, Emily Simonoff, Tony O'sullivan, Evelin Tseng, Juliet Kennedy, Tony Charman, and Gillian Baird. "Emotional and behavioural problems in young children with autism spectrum disorder." Developmental Medicine & Child Neurology 58, no. 2 (2016): 202-208.

Chen, Chien-Hsu, I-Jui Lee, and Ling-Yi Lin. "Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions." Computers in Human Behavior 55 (2016): 477-485.

L. Berkovits, A. Eisenhower, J. Blacher, , "Emotion Regulation in Young Children with Autism Spectrum Disorder,"Journal of Autism and Developmental Disorders, Volume 47, Issue 1, (2017): 68–79.

Deodhare, Dipti. "Facial Expressions to Emotions: A Study of Computational Paradigms for Facial Emotion Recognition." In Understanding Facial Expressions in Communication, pp. 173-198. Springer India, 2015.

Palestra, Giuseppe, Adriana Pettinicchio, Marco Del Coco, Pierluigi Carcagnì, Marco Leo, and Cosimo Distante. "Improved performance in facial expression recognition using 32 geometric features." In International Conference on Image Analysis and Processing, pp. 518-528. Springer, Cham, 2015.

Ayesh, Aladdin, and William Blewitt. "Models for computational emotions from psychological theories using type I fuzzy logic." Cognitive Computation 7, no. 3 (2015): 285-308.

Ngo, Thi Duyen, Thi Hong Nhan Vu, and Viet Ha Nguyen. "Improving simulation of continuous emotional facial expressions by analyzing videos of human facial activities." In International Conference on Principles and Practice of Multi-Agent Systems, pp. 222-237. Springer, Cham, 2014.

Bakshi, Urvashi, and Rohit Singhal. "A survey on face detection methods and feature extraction techniques of face recognition." International Journal of Emerging Trends & Technology in Computer Science (IJETTCS) 3, no. 3 (2014): 233-237.

Heinsfeld, Anibal Sólon, et al. "Identification of autism spectrum disorder using deep learning and the ABIDE dataset." NeuroImage: Clinical 17 (2018): 16-23.

Babu, G. H., Srinivas, M., Gnanaprakasam, C., Prabu, R. T., Devi, M. R., Ahammad, S. H., ... & Rashed, A. N. Z. (2023). Meander Line Base Asymmetric Co-planar Wave Guide (CPW) Feed Tri-Mode Antenna for Wi-MAX, North American Public Safety and Satellite Applications. Plasmonics, 18(3), 1007-1018.

Krishnamoorthy, N. V., KH, S. M., Gnanaprakasam, C., Swarna, M., & Geetha, R. (2023, April). A Robust Blockchain Assisted Electronic Voting Mechanism with Enhanced Cyber Norms and Precautions. In 2023 Eighth International Conference on Science Technology Engineering and Mathematics (ICONSTEM) (pp. 1-8). IEEE.

Mohan, A., & K, S. . (2023). Computational Technologies in Geopolymer Concrete by Partial Replacement of C&D Waste. International Journal of Intelligent Systems and Applications in Engineering, 11(4s), 282–292. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2666.

Swarna, M., Geetha, R., Saranya, G., KH, S. M., & Gnanaprakasam, C. (2023, April). An Empirical Design of IoT based Health Surveillance Scheme for Coronavirus Affected Patients. In 2023 Eighth International Conference on Science Technology Engineering and Mathematics (ICONSTEM) (pp. 1-8). IEEE.

Geetha, R., Krishnamoorthy, N. V., Murugan, K. S., Gnanaprakasam, C., & Swarna, M. (2023, April). A Novel Deep Learning based Stress Analysis and Detection Scheme using Characteristic Data. In 2023 Eighth International Conference on Science Technology Engineering and Mathematics (ICONSTEM) (pp. 1-8). IEEE.

Gnanaprakasam, C., Indumathy, M., Khilar, R., & Kumar, P. S. (2022). Artificial intelligence based optimization for mapping IP addresses to prevent cyber-based attacks. Measurement: Sensors, 24, 100508.

Gnanaprakasam, C., Anand, S., Manoj Kumar, R., & Menaka, R. (2021). Facial Expression Image Analysis to Classify High and Low Level ASD Kids Using Attention Mechanism Embedded Deep Learning Technique. In Advances in Electrical and Computer Technologies: Select Proceedings of ICAECT 2020 (pp. 559-568). Springer Singapore.

Diksha Siddhamshittiwar. (2017). An Efficient Power Optimized 32 bit BCD Adder Using Multi-Channel Technique. International Journal of New Practices in Management and Engineering, 6(02), 07 - 12. https://doi.org/10.17762/ijnpme.v6i02.57.

C. Gnanaprakasam, Manoj Kumar Rajagopal, Attention Residual Network for Micro-expression Recognition Using Image Analysis, in Journal of Advanced Research in Dynamical & Control Systems, 07-Special Issue,2020, Pages- 1261 – 1272.

Gnanaprakasam, C., and Manoj Kumar Rajagopal. "Review on Facial Micro-Expression Detection." Int J Innov Technol Explor Eng 8 (2019): 1103-1115.

Sumathi, S., C. Gnanaprakasam, and R. RANIHEMA MALINI. "Face Recognition-Average-Half-Face Using Wavelets." IPCV 2010: proceedings of the 2010 international conference on image processing, computer vision, & pattern recognition (Las Vegas NV, July 12-15, 2010). 2010.

Gnanaprakasam, C., S. Sumathi, and R. RaniHema Malini. "Average-half-face in 2D and 3D using wavelets for face recognition." Proceedings of the 9th WSEAS international conference on Signal processing. 2010.

Gnanaprakasam, C., and M. Rajagopal. "K.,(2023). Identification of Autism Spectrum Disorder using Residual Attention Net-work for Facial Image Analysis." J Curr Trends Comp Sci Res 2.1: 31-39.

Fatima Abbas, Deep Learning Approaches for Medical Image Analysis and Diagnosis , Machine Learning Applications Conference Proceedings, Vol 3 2023.

Patnam, Venkata Sindhoor Preetham, et al. "Deep learning based recognition of meltdown in autistic kids." 2017 IEEE International Conference on Healthcare Informatics (ICHI). IEEE, 2017.

Florio, Tony, et al. "Providing an independent second opinion for the diagnosis of autism using artificial intelligence over the internet." Couns, Psycho Health Use Technol Mental Health 5 (2009): 232-248