A static hand gesture recognition model based on the improved centroid watershed algorithm and a dual-channel CNN

Xude Dong, Yuanping Xu, Zhijie Xu, Jian Huang, Jun Lu, Chaolong Zhang, Li Lu

Research output: Chapter in Book or Report/Conference proceedingConference Proceedingpeer-review

3 Citations (Scopus)

Abstract

In order to achieve static hand gesture recognization within complex skin-like background regions in an effective and intelligent manner, this study proposed an integrated hand gesture recognition model based on the improved centroid watershed algorithm (ICWA) and a dual-channel convolutional neural network (DCCNN) structure. The effectiveness of this approach stemmed from more accurate segmentation of hand gestures from an original image by using the ICWA. The segmented image and the corresponding Local Binary Patterns (LBP) features extracted from the original image then serve as inputs for two channels of the devised DCCNN respectively for classification. The contributions of this study included an innovative method for reducing the image gradient difference while segmenting in the YCrCb color space, and the fusion of both Principal Component Analysis (PCA) for dimension reduction and a convexity detection process for identifying the secant line between the palm and arm. The devised DCCNN enables significant improvement on the static hand gesture classification accuracy by employing independent dual-convolution neural network framework for dealing with richer features at different scales. Tests and evaluations on benchmarking databases demonstrated that the devised models and techniques outperform classic methods with distinctive advantages when operating under challenging skin-like background conditions.

Original languageEnglish
Title of host publicationICAC 2018 - 2018 24th IEEE International Conference on Automation and Computing
Subtitle of host publicationImproving Productivity through Automation and Computing
EditorsXiandong Ma
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781862203426
DOIs
Publication statusPublished - Sept 2018
Externally publishedYes
Event24th IEEE International Conference on Automation and Computing, ICAC 2018 - Newcastle upon Tyne, United Kingdom
Duration: 6 Sept 20187 Sept 2018

Publication series

NameICAC 2018 - 2018 24th IEEE International Conference on Automation and Computing: Improving Productivity through Automation and Computing

Conference

Conference24th IEEE International Conference on Automation and Computing, ICAC 2018
Country/TerritoryUnited Kingdom
CityNewcastle upon Tyne
Period6/09/187/09/18

Keywords

  • Centroid watershed algorithm
  • Dual-channel convolution neural network
  • Hand gesture recognition
  • Hand gesture segmentation

Fingerprint

Dive into the research topics of 'A static hand gesture recognition model based on the improved centroid watershed algorithm and a dual-channel CNN'. Together they form a unique fingerprint.

Cite this