A new approach of audio emotion recognition

Chien Shing Ooi*, Kah Phooi Seng, Li Minn Ang, Li Wern Chew

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

96 Citations (Scopus)

Abstract

A new architecture of intelligent audio emotion recognition is proposed in this paper. It fully utilizes both prosodic and spectral features in its design. It has two main paths in parallel and can recognize 6 emotions. Path 1 is designed based on intensive analysis of different prosodic features. Significant prosodic features are identified to differentiate emotions. Path 2 is designed based on research analysis on spectral features. Extraction of Mel-Frequency Cepstral Coefficient (MFCC) feature is then followed by Bi-directional Principle Component Analysis (BDPCA), Linear Discriminant Analysis (LDA) and Radial Basis Function (RBF) neural classification. This path has 3 parallel BDPCA + LDA + RBF sub-paths structure and each handles two emotions. Fusion modules are also proposed for weights assignment and decision making. The performance of the proposed architecture is evaluated on eNTERFACE'05 and RML databases. Simulation results and comparison have revealed good performance of the proposed recognizer.

Original languageEnglish
Pages (from-to)5858-5869
Number of pages12
JournalExpert Systems with Applications
Volume41
Issue number13
DOIs
Publication statusPublished - 1 Oct 2014
Externally publishedYes

Keywords

  • Audio emotion recognition
  • MFCC feature
  • Prosodic features
  • RBF neural network

Cite this