Hybrid Emotion Classification of MOOC Reviews Using the NRC Lexicon and a Multi-Channel Deep Learning Model
Article Sidebar
Main Article Content
Abstract
Text-based emotion recognition has received extensive attention in applied computing research, but its effectiveness in online learning contexts remains limited. In this study, we introduce the TriFusion Attention Network, a hybrid deep learning model that classies emotions in Massive Open Online Course (MOOC) reviews. Using the NRC Emotion Lexicon, we annotated learner reviews and designed the model to integrate multiple channels capturing both semantic and affective information. Its architecture combines Bidirectional Long Short-Term Memory (BiLSTM), Bidirectional Gated Recurrent Units (BiGRU), Convolutional Neural Networks (CNN), and attention mechanisms to model the complexity of learner feedback effectively. Experiments conducted on Coursera reviews demonstrate that the model effectively identifies both explicit and subtle emotional cues, achieving over 95% accuracy, F1-scores around 0.95, and AUC-ROC values approaching 0.99 on both balanced and imbalanced datasets. These results confirm that the proposed approach achieves superior performance compared to existing methods and facilitates improved learner engagement while offering richer analytical insights into their experiences.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
K. F. Hew and W. S. Cheung, “Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges,” Educational Research Review, vol. 12, pp. 45–58, Jun. 2014.
S. Zheng, M. B. Rosson, P. C. Shih and J. M. Carroll, “Understanding Student Motivation, Behaviors and Perceptions in MOOCs,” in Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, in CSCW ’15, New York, NY, USA: Association for Computing Machinery, pp. 1882–1895, Feb. 2015.
S. S. I. ElShafie, S. S. Ismail, K. A. H. Bahnasy and M. M. Aref, “Convolutional Neural Network Multi-Emotion Classifiers,” Jordanian Journal of Computers and Information Technology (JJCIT), vol. 5, no. 2, pp. 97–97, Jul. 2019.
S. M. Mohammad, “9 Sentiment Analysis: Detecting Valence, Emotions, and Other Affectual States from Text,” in Emotion Measurement, H. L. Meiselman, Ed., Woodhead Publishing, pp. 201–237, 2016.
H. Alhuzali and S. Ananiadou, “SpanEmo: Casting Multi-label Emotion Classification as Spanprediction,” in Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, P. Merlo, J. Tiedemann, and R. Tsarfaty, Eds., Online: Association for Computational Linguistics, pp. 1573–1584, Apr. 2021.
S. M. Mohammad and P. D. Turney, “Crowdsourcing A Word–Emotion Association Lexicon,” Accessed: Apr. 28, 2025.
[Online]. Available: https://onlinelibrary.wiley.com/ doi/10.1111/j.1467-8640.2012.00460.x
Y. Kim, “Convolutional Neural Networks for Sentence Classification,” in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), A. Moschitti, B. Pang, and W. Daelemans, Eds., Doha, Qatar: Association for Computational Linguistics, pp. 1746–1751, Oct. 2014.
A. Vaswani et al., “Attention is all you need,” in Proceedings of the 31st International Conference on Neural Information Processing Systems, in NIPS’17, Red Hook, NY, USA: Curran Associates Inc., pp. 6000–6010, Dec. 2017,.
J. Mourad, T. Hiba, R. Yassir and H. Imad, “ERABQS: entity resolution based on active machine learning and balancing query strategy,” Journal of Intelligent Information Systems, vol. 62, no. 5, pp. 1347–1373, Mar. 2024.
M. Jabrane, H. Tabbaa, A. Hadri, and I. Hafidi, “Enhancing Entity Resolution with a hybrid Active Machine Learning framework: Strategies for optimal learning in sparse datasets,” Information Systems, vol. 125, , Nov. 2024.
R. Ouadad and H. Mouncif, “Sentiment Analysis of Students Feedback in Online Courses Using Supervised, Ensemble, and Transfer Learning Methods,” in Proceedings of the 7th International Conference on Networking, Intelligent Systems and Security, in NISS ’24, New York, NY, USA: Association for Computing Machinery, pp. 1–7, Aug. 2024.
P. Rajpurkar, J. Zhang, K. Lopyrev and P. Liang, “SQuAD: 100,000+ Questions for Machine Comprehension of Text,” in Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, J. Su, K. Duh, and X. Carreras, Eds., Austin, Texas: Association for Computational Linguistics, pp. 2383–2392, Nov. 2016.
S. Peng and L. Cao, “Emotion Classification in Textual Conversations Using Deep Broad Learning,” in Textual Emotion Classification Using Deep Broad Learning, Springer, Cham, pp. 119–133, 2024.
N. Altrabsheh, M. Cocea and S. Fallahkhair, “Sentiment Analysis: Towards a Tool for Analysing Real-Time Students Feedback,” 2014 IEEE 26th International Conference on Tools with Artificial Intelligence, Limassol, Cyprus, pp. 419-423, 2014.
S. Poria, E. Cambria, and A. Gelbukh, “Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, L. M`arquez, C. Callison-Burch, and J. Su, Eds., Lisbon, Portugal: Association for Computational Linguistics, pp. 2539–2544, Sep. 2015.
A. Seyeditabari, N. Tabari, and W. Zadrozny, “Emotion Detection in Text: A Review,” arXiv preprint arXiv:1806.00674, 2018
H. Makhoukhi and S. Roubi, “Multi-Label Emotion Classification of Online Learners’ Reviews Using Machine Learning,” in Proceedings of the 2024 5th International Conference on Education Development and Studies, in ICEDS ’24, New York, NY, USA: Association for Computing Machinery, pp. 59–64, Jul. 2024.
K. Z. Aung and N. N. Myo, “Sentiment analysis of students’ comment using lexicon based approach,” 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS), Wuhan, China, pp. 149-154, 2017.
R. Faizi, “Using Sentiment Analysis to Explore Student Feedback: A Lexical Approach,” International Journal of Emerging Technologies in Learning (iJET), vol. 18, no. 09, Art. no. 09, May 2023.
Z. Kastrati, B. Arifaj, A. Lubishtani, F. Gashi and E. Nishliu, “Aspect-Based Opinion Mining of Students’ Reviews on Online Courses,” in Proceedings of the 2020 6th International Conference on Computing and Artificial Intelligence, in ICCAI ’20, New York, NY, USA: Association for Computing Machinery, pp. 510–514, Aug. 2020.
R. Sadigov, E. Yıldırım, B. Koca¸cınar, F. Patlar Akbulut and C. Catal, “Deep learning-based user experience evaluation in distance learning,” Cluster Computing , vol. 27, pp. 443–455, 2024.
B. Patrick, E. Skinner and J. Connell, “What Motivates Children’s Behavior and Emotion? Joint Effects of Perceived Control and Autonomy in the Academic Domain,” Journal of Personality and Social Psycholply, vol. 65, pp. 781–91, Oct. 1993.
R. Pekrun, T. Goetz, A. Frenzel, P. Barchfeld and R. Perry, “Measuring emotions in students’ learning and performance: The Achievement Emotions Questionnaire (AEQ),” Contemporary Educational Psychology, vol. 36, pp. 36–48, Jan. 2011.
F. Tian et al., “Recognizing and regulating elearners’ emotions based on interactive Chinese texts in e-learning systems,” Knowledge-Based Systems, vol. 55, pp. 148–164, Jan. 2014.
R. Oramas Bustillos, R. Zatarain Cabada, M. L. Barr´on Estrada and Y. Hern´andez P´erez, “Opinion mining and emotion recognition in an intelligent learning environment,” Computer Applications in Engineering Education, vol. 27, no. 1, pp. 90–101, Jan. 2019.
P. Kumar, “Exploring the Students Feelings and Emotion Towards Online Teaching: Sentimental 595 Analysis Approach,” IFIP Advances in Information and Communication Technology, vol. 617, pp. 137–146, Dec. 2020.
M. L. Barr´on Estrada, R. Zatarain Cabada, R. Oramas Bustillos and M. Graff, “Opinion mining and emotion recognition applied to learning environments,” Expert Systems with Applications, vol. 150, p. 113265, Jul. 2020.
X. Feng, Y. Wei, X. Pan, L. Qiu and Y. Ma, “Academic Emotion Classification and Recognition Method for Large-scale Online Learning Environment—Based on A-CNN and LSTM-ATT Deep Learning Pipeline Method,” International Journal of Environmental Research and Public Health, vol. 17, no. 6, p. 1941, Mar. 2020.
A. Tzacheva and A. Easwaran, “Emotion Detection and Opinion Mining from Student Comments for Teaching Innovation Assessment,” International Journal of Education (IJE), vol. 09, no. 02, pp. 21–32, Jun. 2021.
S. Ji and T. Fangbi, “Emotion Analysis Model of MOOC Course Review Based on BiLSTM,” International Journal of Emerging Technologies in Learning, vol. 16, no. 08, Art. no. 08, Apr. 2021.
M. Z. Asghar et al., “An Efficient Classification of Emotions in Students’ Feedback using Deep Neural Network,” in 2022 13th International Conference on Information and Communication Systems (ICICS), , pp. 186–191, Jun. 2022.
P. S. Kasliwal, R. Gunjan and V. Shete, “Computation of E-learners Textual Emotion to Enhance learning Experience,” International Journal of Intelligent Systems and Applications in Engineering, vol. 11, no. 10s, Art. no. 10s, Aug. 2023.
V. Kamakshamma, “Adaptive Deep Learning Framework for Emotion Classification in Student Data Using Transformer Models and Advanced Evaluation Metrics,” Journal of Information Systems Engineering and Management, vol. 10, pp. 276–286, Mar. 2025.
M. Hosseinzadeh et al., “Data cleansing mechanisms and approaches for big data analytics: a systematic study,” Journal of Ambient Intelligence and Humanized Computing, vol. 14, pp. 1–13, Nov. 2021.
S. M. Mohammad and P. D. Turney, “Crowdsourcing a Word-Emotion Association Lexicon,” Computational Intelligence, vol. 29, no. 3, pp. 436–465, Aug. 2013.
