结合双胞胎结构与生成对抗网络的半监督遥感图像融合

Shanshan Huang, Qian Jiang, Xin Jin*, Shinjye Lee, Jianan Feng, Shaowen Yao

*Corresponding author for this work

研究成果: Article同行評審

摘要

To solve the problems of acquisition of label image and spectral distortion in the current remote sensing image fusion, a semi-supervised remote sensing image fusion method using Siamese structure is proposed. This method adopted a generative adversarial network structure composed of generator and discriminator, in which the generator contains two encoders and a decoder. First, the multispectral image is amplified and converted into HSV color space. Then, the V channel of the multispectral image and panchromatic images are respectively input into the Siamese network of the encoder, and the image features are extracted through the convolutional layer and the multi-skip connection layer model. Third, the obtained feature map is input to the decoder for image reconstruction. And the fused V channel image is identified by the discriminator, so as to obtain the optimal fusion result. Finally, the fused V channel is concatenated with the H and S channels of the multispectral image to obtain the final fused image. In addition, a compound loss function is designed. Experiments on QuickBird satellite remote sensing image dataset show that this method can effectively improve spatial details and color information in fused images. Compared with the contrast algorithms, the fusion images have certain advantages in subjective visual quality and objective evaluation index.

貢獻的翻譯標題Semi-Supervised Remote Sensing Image Fusion Method Combining Siamese Structure with Generative Adversarial Networks
原文???core.languages.zh_TW???
頁(從 - 到)92-105
頁數14
期刊Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics
33
發行號1
DOIs
出版狀態Published - 20 一月 2021

Keywords

  • Conditional generative adversarial networks
  • Multispectral image
  • Panchromatic image
  • Remote sensing image fusion
  • Siamese networks

指紋 深入研究「结合双胞胎结构与生成对抗网络的半监督遥感图像融合」主題。共同形成了獨特的指紋。

引用此