Energy Efficient Graph-Based Hybrid Learning for Speech Emotion Recognition on Humanoid Robot

Haowen Wu, Hanyue Xu, Kah Phooi Seng*, Jieli Chen, Li Minn Ang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

This paper presents a novel deep graph-based learning technique for speech emotion recognition which has been specifically tailored for energy efficient deployment within humanoid robots. Our methodology represents a fusion of scalable graph representations, rooted in the foundational principles of graph signal processing theories. By delving into the utilization of cycle or line graphs as fundamental constituents shaping a robust Graph Convolution Network (GCN)-based architecture, we propose an approach which allows the capture of relationships between speech signals to decode intricate emotional patterns and responses. Our methodology is validated and benchmarked against established databases such as IEMOCAP and MSP-IMPROV. Our model outperforms standard GCNs and prevalent deep graph architectures, demonstrating performance levels that align with state-of-the-art methodologies. Notably, our model achieves this feat while significantly reducing the number of learnable parameters, thereby increasing computational efficiency and bolstering its suitability for resource-constrained environments. This proposed energy-efficient graph-based hybrid learning methodology is applied towards multimodal emotion recognition within humanoid robots. Its capacity to deliver competitive performance while streamlining computational complexity and energy efficiency represents a novel approach in evolving emotion recognition systems, catering to diverse real-world applications where precision in emotion recognition within humanoid robots stands as a pivotal requisite.

Original languageEnglish
Article number1151
JournalElectronics (Switzerland)
Volume13
Issue number6
DOIs
Publication statusPublished - Mar 2024

Keywords

  • energy efficient deep learning
  • graph convolutional neural network
  • humanoid robot
  • speech emotion recognition

Fingerprint

Dive into the research topics of 'Energy Efficient Graph-Based Hybrid Learning for Speech Emotion Recognition on Humanoid Robot'. Together they form a unique fingerprint.

Cite this