Face Super-Resolution via Joint Edge Information and Attention Aggregation Network

Yue Yu, Jielin Jiang, Heyou Chang, Hao Zheng, Shuihua Wang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Face super-resolution (SR) is a specialized image super-resolution problem that is particularly relevant in various intelligent transportation scenes such as video surveillance and identification systems. Deep learning-steered solutions for face images often leverage facial priors (i.e., face parsing and landmark) to restore intricate facial components and have demonstrated promising performance. However, these methods typically rely on abundant manually labeled data and require lengthy training times. In this work, we introduce a meaningful approach called the Joint Edge Information and Attention Aggregation Network (JEANet) for the face SR problem. JEANet is established on our carefully designed Face Attention Aggregation Module (FAAM), which incorporates parallel connections of both channel-wise and spatial-wise features. Specifically, we integrate an attention fusion strategy into the residual blocks and elaborately employ edge blocks to extract edge information. Additionally, we introduce adaptive shortcuts that interpolate reconstruction parts at multiple scales. With the aid of adaptive shortcuts, JEANet effectively restores detailed images textures by leveraging contextual features optimally. These considerations enable the convolutional operations to flexibly distill information related to primary facial structures and progressively incorporate edge information to assemble local and global meaningful structures. Qualitative and quantitative evaluations demonstrate that our proposed method excels in recovering highly realistic face images compared to several competitive face SR methods.

Original languageEnglish
Article number108931
JournalComputers and Electrical Engineering
Volume111
DOIs
Publication statusPublished - Oct 2023
Externally publishedYes

Keywords

  • Attention mechanism
  • Edge block
  • Face super-resolution
  • Residual block

Fingerprint

Dive into the research topics of 'Face Super-Resolution via Joint Edge Information and Attention Aggregation Network'. Together they form a unique fingerprint.

Cite this