SDRCNN: A Single-Scale Dense Residual Connected Convolutional Neural Network for Pansharpening

Yuan Fang, Yuanzhi Cai, Lei Fan*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Pansharpening is a process of fusing a high spatial resolution panchromatic image and a low spatial resolution multispectral (MS) image to create a high-resolution MS image. A novel single-branch, single-scale lightweight convolutional neural network, named SDRCNN, is developed in this article. By using a novel dense residual connected structure and convolution block, SDRCNN achieved a better tradeoff between accuracy and efficiency. The performance of SDRCNN was tested using four datasets from the WorldView-3, WorldView-2, and QuickBird satellites. The compared methods include eight traditional methods (i.e., GS, Gram-Schmidt adaptive, partial replacement adaptive CS, band-related spatial detail, smoothing-filter-based intensity modulation, GLP-CBD, CDIF, and LRTCFPan) and five lightweight deep-learning methods (i.e., pansharpening neural network, PanNet, BayesianNet, DMDNet, and FusionNet). Based on a visual inspection of the pansharpened images created and the associated absolute residual maps, SDRCNN exhibited least spatial detail blurring and spectral distortion, among all the methods considered. The values of the quantitative evaluation metrics were closest to their ideal values when SDRCNN was used. The processing time of SDRCNN was also the shortest among all methods tested. Finally, the effectiveness of each component in the SDRCNN was demonstrated in ablation experiments. All of these confirmed the superiority of SDRCNN.

Original languageEnglish
Pages (from-to)6325-6338
Number of pages14
JournalIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Volume16
DOIs
Publication statusPublished - 2023

Keywords

  • Convolutional neural network (CNN)
  • deep learning (DL)
  • fusion
  • multispectral (MS) image
  • pansharpening
  • resolution

Fingerprint

Dive into the research topics of 'SDRCNN: A Single-Scale Dense Residual Connected Convolutional Neural Network for Pansharpening'. Together they form a unique fingerprint.

Cite this