TY - GEN
T1 - Lightweight Remote Sensing Image Denoising via Knowledge Distillation
AU - Lin, Yi
AU - Cai, Zhouyin
AU - Li, Jia
AU - Zhang, Junjie
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Since multispectral remote sensing images (RSIs) contain the abundant information of the surface environment, they have been widely applied in diverse research areas, such as earth observation, agricultural monitoring, and geological exploration. However, RSIs generally suffer from the interference of random noise during the recording and transmission, which significantly impacts the accuracy and reliability of subsequent tasks. Existing neural network-based denoising methods often rely on the heavy parameters to model the generation process of the clean image from its noisy counterpart. However, it is time-consuming deploying such model in real application scenarios. To address the above issue, we present a lightweight denoising model based on the proposed Simplified Residual Spatial-Spectral Module (SRSSM) to effectively extract the spatial and spectral features of RSIs, while maintaining a low computation complexity. A training strategy based on the knowledge distillation is designed to constrain the feature distribution by referring to a larger teacher model. Extensive experiments demonstrate the effectiveness and efficiency of the proposed method compared against existing models. Moreover, the downstream tasks including object detection and clustering are performed on the denoised images to further validate the necessity of denoising process.
AB - Since multispectral remote sensing images (RSIs) contain the abundant information of the surface environment, they have been widely applied in diverse research areas, such as earth observation, agricultural monitoring, and geological exploration. However, RSIs generally suffer from the interference of random noise during the recording and transmission, which significantly impacts the accuracy and reliability of subsequent tasks. Existing neural network-based denoising methods often rely on the heavy parameters to model the generation process of the clean image from its noisy counterpart. However, it is time-consuming deploying such model in real application scenarios. To address the above issue, we present a lightweight denoising model based on the proposed Simplified Residual Spatial-Spectral Module (SRSSM) to effectively extract the spatial and spectral features of RSIs, while maintaining a low computation complexity. A training strategy based on the knowledge distillation is designed to constrain the feature distribution by referring to a larger teacher model. Extensive experiments demonstrate the effectiveness and efficiency of the proposed method compared against existing models. Moreover, the downstream tasks including object detection and clustering are performed on the denoised images to further validate the necessity of denoising process.
KW - Image Denoising
KW - Knowledge Distillation
KW - Remote Sensing Images
UR - http://www.scopus.com/inward/record.url?scp=85143625723&partnerID=8YFLogxK
U2 - 10.1109/MMSP55362.2022.9949236
DO - 10.1109/MMSP55362.2022.9949236
M3 - Conference Proceeding
AN - SCOPUS:85143625723
T3 - 2022 IEEE 24th International Workshop on Multimedia Signal Processing, MMSP 2022
BT - 2022 IEEE 24th International Workshop on Multimedia Signal Processing, MMSP 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 24th IEEE International Workshop on Multimedia Signal Processing, MMSP 2022
Y2 - 26 September 2022 through 28 September 2022
ER -