HGR-ResNet: Hand Gesture Recognition with Enhanced Residual Neural Network

Chun Keat Tan*, Kian Ming Lim, Chin Poo Lee, Roy Kwang Yang Chang, Jit Yan Lim

*Corresponding author for this work

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

1 Citation (Scopus)

Abstract

Hand Gesture Recognition (HGR) has garnered increasing attention in recent years due to its potential to enhance human-computer interaction (HCI) and facilitate communication between individuals who are mute or deaf and the wider public. HGR can facilitate non-contact interaction between humans and machines, offering an effective interface for recognizing sign language used in everyday communication. This paper proposes a novel approach for static HGR using transfer learning of ResNet152 with early stopping, adaptive learning rate, and class weightage techniques, referred to as HGR-ResNet. Transfer learning enables the model to utilize previously acquired knowledge from pre-training on a large dataset, allowing it to learn from pre-extracted image features. Early stopping serves as a regularization technique, halting the training process before overfitting occurs. Adaptive learning rate adjusts the learning rate dynamically based on the model's error rate during training, promoting faster convergence and improved accuracy. Additionally, the class weightage technique is employed to address the issue of class imbalance in the data, ensuring fair representation and mitigating biases during the training process. To assess the effectiveness of the proposed model, we conduct a comparative analysis with multiple existing methods using three distinct datasets: the American Sign Language (ASL) dataset, ASL with digits dataset, and the National University of Singapore (NUS) hand gesture dataset. HGR-ResNet achieves remarkable results, with an average accuracy of 99.20% across all three datasets, and individual accuracies of 99.88% for the ASL dataset, 98.93% for the ASL with digits dataset, and 98.80% for the NUS hand gesture dataset.

Original languageEnglish
Title of host publication2023 11th International Conference on Information and Communication Technology, ICoICT 2023
Pages131-136
Number of pages6
ISBN (Electronic)9798350321982
DOIs
Publication statusPublished - 2023
Externally publishedYes
Event11th International Conference on Information and Communication Technology, ICoICT 2023 - Melaka, Malaysia
Duration: 23 Aug 202324 Aug 2023

Publication series

Name2023 11th International Conference on Information and Communication Technology, ICoICT 2023
Volume2023-August

Conference

Conference11th International Conference on Information and Communication Technology, ICoICT 2023
Country/TerritoryMalaysia
CityMelaka
Period23/08/2324/08/23

Keywords

  • Hand gesture recognition
  • Human-computer interaction
  • ResNet
  • Sign language recognition

Fingerprint

Dive into the research topics of 'HGR-ResNet: Hand Gesture Recognition with Enhanced Residual Neural Network'. Together they form a unique fingerprint.

Cite this