Comparative Analysis on Deep Learning based Pan-sharpening of Very High-Resolution Satellite Images

Authors : Peijuan WANG, Ugur ALGANCİ, Elif SERTEL

Pages : 150-165

Doi:10.30897/ijegeo.834760

View : 17 | Download : 8

Publication Date : 2021-06-15

Article Type : Research Paper

Abstract :Pan-sharpening is a fundamental task of remote sensing, aiming to produce a synthetic image having high spatial and spectral resolution of original panchromatic and multispectral images. In recent years, as in other tasks of the remote sensing field, deep learning based approaches have been developed for this task. In this research, a detailed comparative analysis was conducted to evaluate the performance and visual quality of pan-sharpening results from traditional algorithms and deep learning-based models. For this purpose, the deep learning based methods that are CNN based pan-sharpening insert ignore into journalissuearticles values(PNN);, Multiscale and multi-depth convolutional neural networks insert ignore into journalissuearticles values(MSDCNN); and Pan-sharpened Generative Adversarial Networks insert ignore into journalissuearticles values(PSGAN); and traditional methods that are Brovey, PCA, HIS, Indusion and PRACS were applied. Analysis were performed on regions with different land cover characteristics to evaluate the stability of the methods. In addition, effects of the filter size, spectral indices, activation and loss functions on the pan-sharpening were investigated. For the accuracy assessment, commonly used with-reference and without-reference quality metrics were computed in addition to visual quality evaluations. According to results, the deep learning-based methods provided promising results in both the reduced resolution and full resolution experiments, while PRACS method outperformed other traditional algorithms in most of the experimental configurations.
Keywords : Pan sharpening, Deep Learning, Convolutional Neural Network, Satellite Image