Aggregated pyramid gating network for human pose estimation without pre-training

Chenru Jiang, Kaizhu Huang*, Shufei Zhang, Xinheng Wang, Jimin Xiao, Yannis Goulermas

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

8 Citations (Scopus)

Abstract

In this work, we propose a comprehensive aggregated residual gating structure, the Pyramid GAting Network (PGA-Net) for human pose estimation which can select, distill, and fuse semantic level and natural level information from multiple scales. In comparison, through utilizing multi-scale features, most existing state-of-the-art pose estimation methods are still limited in three aspects. First, multi-scale features contain massively redundant information, which is unfortunately not distilled by most existing approaches. Second, preferring deeper network structures to extract strong semantic features, the conventional methods often ignore original texture information fusion. Third, to attain a good parameter initialization, the current methods heavily rely on pre-training, which is very time-consuming or even unavailable. While better coping with the above problems, our proposed PGA-Net distills high-level semantic features and replenishes low-level original information to reinforce module representation capability. Meanwhile, PGA-Net demonstrates notable training stability and superior performance even without pre-training. Extensive experiments demonstrate that our method consistently outperforms previous approaches even without pre-training, enabling thus an end-to-end model training from scratch. In COCO benchmark, PGA-Net consistently achieves over 3% improvements than the baseline (without pre-training) under various model configurations.1

Original languageEnglish
Article number109429
JournalPattern Recognition
Volume138
DOIs
Publication statusPublished - Jun 2023

Keywords

  • Human pose estimation
  • Pyramid gating system
  • Stabilization

Fingerprint

Dive into the research topics of 'Aggregated pyramid gating network for human pose estimation without pre-training'. Together they form a unique fingerprint.

Cite this