TY - GEN
T1 - Enhancing Multilingual Emotion Classification with Attention Mechanism for Transnational Education
AU - Wu, Tianyi
AU - Huang, Yongrun
AU - Purwanto, Erick
AU - Juwono, Filbert H.
AU - Tang, Fu Ee
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - In the context of transnational education, understanding emotional expressions across languages is essential for developing effective communication and fostering global perspectives in students. This paper uses innovative natural language processing techniques to explore sentiment dynamics in a multilingual setting. We propose an improved XLM-RoBERTa framework that integrates a multihead self-attention and attention pooling mechanism. The SemEval2018 Task 1 dataset is used as it covers Arabic, English, and Spanish. In particular, Low-rank Adaptation (LoRA), which is an attention mechanism, is used for efficient parameter fine-tuning, which made it scalable for deployment in resource-constrained educational environments. The results show that our proposed model achieves an accuracy of 0.87 and an F1-score of 0.85, higher than the baseline models. Finally, this research contributes to shaping innovative learning strategies that prepare students for a globally connected future.
AB - In the context of transnational education, understanding emotional expressions across languages is essential for developing effective communication and fostering global perspectives in students. This paper uses innovative natural language processing techniques to explore sentiment dynamics in a multilingual setting. We propose an improved XLM-RoBERTa framework that integrates a multihead self-attention and attention pooling mechanism. The SemEval2018 Task 1 dataset is used as it covers Arabic, English, and Spanish. In particular, Low-rank Adaptation (LoRA), which is an attention mechanism, is used for efficient parameter fine-tuning, which made it scalable for deployment in resource-constrained educational environments. The results show that our proposed model achieves an accuracy of 0.87 and an F1-score of 0.85, higher than the baseline models. Finally, this research contributes to shaping innovative learning strategies that prepare students for a globally connected future.
KW - emotion classification
KW - LoRA
KW - multilingual
KW - transnational education
KW - XLM-RoBERTa
UR - https://www.scopus.com/pages/publications/105018068812
U2 - 10.1109/ICAIE64856.2025.11158599
DO - 10.1109/ICAIE64856.2025.11158599
M3 - Conference Proceeding
AN - SCOPUS:105018068812
T3 - 2025 International Conference on Artificial Intelligence and Education, ICAIE 2025
SP - 347
EP - 351
BT - 2025 International Conference on Artificial Intelligence and Education, ICAIE 2025
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2025 International Conference on Artificial Intelligence and Education, ICAIE 2025
Y2 - 14 May 2025 through 16 May 2025
ER -