An Efficient Probabilistic Deep Learning Model for the Oral Proficiency Assessment of Student Speech Recognition and Classification

Main Article Content

Wenyi Li
Maslawati Mohamad

Abstract

Natural Language Processing is a branch of artificial intelligence (AI) that focuses on the interaction between computers and human language. Speech recognition systems utilize machine learning algorithms and statistical models to analyze acoustic features of speech, such as pitch, duration, and frequency, to convert spoken words into written text. The Student English Oral Proficiency Assessment and Feedback System provides students with a comprehensive evaluation of their spoken English skills and offers tailored feedback to help them improve. It can be used in language learning institutions, universities, or online platforms to support language education and enhance oral communication abilities. In this paper constructed a framework stated as Latent Dirichlet Integrated Deep Learning (LDiDL) for the assessment of student English proficiency assessment. The system begins by collecting a comprehensive dataset of spoken English samples, encompassing various proficiency levels. Relevant features are extracted from the samples, including acoustic characteristics and linguistic attributes. Leveraging Latent Dirichlet Allocation (LDA), the system uncovers latent topics within the data, enabling a deeper understanding of the underlying themes present in the spoken English. To further enhance the analysis, a deep learning model is developed, integrating the LDA topics with the extracted features. This model is trained using appropriate techniques and evaluated using performance metrics. Utilizing the predictions made by the model, the system generates personalized feedback for each student, focusing on areas of improvement such as vocabulary, grammar, fluency, and pronunciation. Simulation mode uses the native English speech audio for the LDiDL training and classification. The experimental analysis stated that the proposed LDiDL model achieves an accuracy of 99% for the assessment of English Proficiency.

Article Details

How to Cite
Li, W. ., & Mohamad, M. . (2023). An Efficient Probabilistic Deep Learning Model for the Oral Proficiency Assessment of Student Speech Recognition and Classification. International Journal on Recent and Innovation Trends in Computing and Communication, 11(6), 411–424. https://doi.org/10.17762/ijritcc.v11i6.7734
Section
Articles

References

McNamara, T. (2022). Proficiency assessment with Natural Language Processing (NLP). In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop (pp. 12-17).

Vajjala, S., & Meurers, D. (2022). NLP-based proficiency assessments: Analyzing language samples for evaluating language skills. Language Testing, 39(1), 45-68.

Burstein, J., & Deane, P. (2023). Advantages of NLP-based proficiency assessments. Language Assessment Quarterly, 20(1), 78-96.

Liu, D., & Kunnan, A. J. (2022). Applications of NLP proficiency assessments in language education and research. In Handbook of Natural Language Processing and Language Assessment (pp. 205-220). Routledge.

Jiao, X., Li, Y., & Wei, W. (2023). Deep learning models in proficiency assessment with NLP: A comprehensive survey. Journal of Artificial Intelligence in Education, 33(1), 45-68.

Waheeb , M. Q. ., SANGEETHA, D., & Raj , R. . (2021). Detection of Various Plant Disease Stages and Its Prevention Method Based on Deep Learning Technique. Research Journal of Computer Systems and Engineering, 2(2), 33:37. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/30

Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. (2011). Natural language processing (almost) from scratch. Journal of Machine Learning Research, 12(Aug), 2493-2537.

Kim, Y., Jernite, Y., Sontag, D., & Rush, A. M. (2016). Character-aware neural language models. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (pp. 2741-2749). AAAI Press.

Chaudhary, S., Liu, X., & Vechtomova, O. (2022). End-to-end neural networks for proficiency assessment. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 84-91). Association for Computational Linguistics.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Communications of the ACM, 60(7), 46-51.

Attali, Y., & Burstein, J. (2016). Automated essay scoring with deep learning models. Assessing Writing, 29, 12-23.

Kunnan, A. J., & Liu, D. (2023). Advancements in proficiency assessment with NLP: A review. Annual Review of Applied Linguistics, 43, 126-145.

Smith, J., & Johnson, A. (2021). NLP-based Proficiency Assessment: A Comprehensive Review. Journal of Language Technology, 25(2), 45-68.

Brown, L., Williams, C., & Davis, M. (2021). Automated Scoring of Spoken English Proficiency using NLP Techniques. Proceedings of the International Conference on Natural Language Processing, 112-125.

Chen, S., Li, X., & Wang, Y. (2021). Evaluating Language Proficiency with Deep Learning Models: A Comparative Study. Journal of Artificial Intelligence Research, 38, 789-805.

Garcia, R., Martinez, E., & Rodriguez, P. (2022). NLP-based Proficiency Assessment for Second Language Learners. Language Learning and Technology, 26(3), 89-105.

Johnson, M., Smith, K., & Thompson, R. (2022). Assessing Proficiency in Academic Writing using NLP Techniques. Journal of Educational Assessment, 45(4), 567-582.

Ansari , A. S. . (2023). Numerical Simulation and Development of Brain Tumor Segmentation and Classification of Brain Tumor Using Improved Support Vector Machine. International Journal of Intelligent Systems and Applications in Engineering, 11(2s), 35–44. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2505

Kim, H., Lee, S., & Park, J. (2022). Deep Learning Approaches for Automated Scoring of Writing Proficiency Tests. International Journal of Applied Linguistics, 32(1), 78-95.

Liu, W., Chen, H., & Wang, Z. (2022). Enhancing Proficiency Assessment in Computer-Assisted Language Learning using NLP. Computer Assisted Language Learning, 35(2), 256-272.

Martinez, L., Lopez, R., & Garcia, M. (2022). Neural Network Models for Automated Oral Proficiency Assessment. Journal of Speech Technology, 19(1), 134-148.

Wanjiku , M., Levi, S., Silva, C., Ji-hoon, P., & Yamamoto, T. Exploring Feature Selection Methods in Support Vector Machines. Kuwait Journal of Machine Learning, 1(3). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/131

Park, S., Kim, J., & Lee, Y. (2023). A Hybrid Approach for Proficiency Assessment using NLP and Machine Learning Techniques. Applied Linguistics, 40(2), 210-225.

Rodriguez, A., Gomez, E., & Fernandez, P. (2023). Language Proficiency Evaluation using Transformer-Based Models. Proceedings of the International Conference on Computational Linguistics, 275-288.

Smith, R., Johnson, B., & Thompson, L. (2023). Automated Scoring of Oral Proficiency Tests: A Comparative Study of NLP Models. Language Testing, 45(3), 346-364.

Wang, J., Li, Q., & Chen, G. (2023). Proficiency Assessment for Chinese as a Second Language using NLP Techniques. Chinese Language Teaching, 36(1), 45-58.

Mr. Kankan Sarkar. (2016). Design and analysis of Low Power High Speed Pulse Triggered Flip Flop. International Journal of New Practices in Management and Engineering, 5(03), 01 - 06. Retrieved from http://ijnpme.org/index.php/IJNPME/article/view/45

Yang, L., Zhang, H., & Xu, Q. (2023). Evaluating Language Proficiency in Computer-Mediated Communication: A Deep Learning Approach. Journal of Computer-Mediated Communication, 28(2), 345-362.

Zhang, Y., Liu, X., & Wang, L. (2023). Proficiency Assessment of Automatic Speech Recognition Systems using NLP-based Metrics. Speech Communication, 65, 78-92.

Zhou, C., Li, M., & Wang, P. (2023). Neural Networks for Automated Scoring of Oral Proficiency Tests: A Comparative Study. International Journal of Language Testing, 37(4), 567-584.