A theoretical and practical survey of image fusion methods for multispectral pansharpening

Yilmaz C. S., Yilmaz V., GÜNGÖR O.

INFORMATION FUSION, cilt.79, ss.1-43, 2022 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 79
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1016/j.inffus.2021.10.001
  • Dergi Adı: INFORMATION FUSION
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Compendex, Computer & Applied Sciences, INSPEC
  • Sayfa Sayıları: ss.1-43
  • Anahtar Kelimeler: image fusion, sparse representation, deep learning, multiresolution analysis, image processing, SPECTRAL RESOLUTION IMAGES, HIGH-SPATIAL-RESOLUTION, SPARSE REPRESENTATION, PANCHROMATIC IMAGES, INTENSITY MODULATION, QUALITY ASSESSMENT, WAVELET TRANSFORM, MULTISCALE FUSION, SATELLITE IMAGES, ALGORITHMS
  • Karadeniz Teknik Üniversitesi Adresli: Evet

Özet

Pansharpening fuses the spatial features of a high-resolution panchromatic (PAN) image with the spectral features of a lower-resolution multispectral (MS) image to generate a spatially enriched MS image. Numerous pansharpening strategies have been developed for more than three decades, which forces the analysts who intend to apply pansharpening to choose from various pansharpening techniques. Hence, this study aims to investigate the performances of many conventional and state-of-the-art pansharpening techniques in order to guide the analysts in this regard. To this aim, the spectral and spatial structure fidelity of the pansharpened images produced from a total of 47 pansharpening methods were evaluated qualitatively and quantitatively. The methods examined were from six pansharpening methods categories, including Multiresolution Analysis (MRA)-based, Component Substitution (CS)-based, Colour-Based (CB), Deep Learning (DL)-based, Variational Optimization (VO)-based and hybrid techniques. The methods in the MRA, DL, CB and VO category were found to exhibit the best pansharpening performances; whereas the hybrid and CS-based techniques showed the poorest performances. We believe that the outcomes of this study will guide the analysts who are in the need to apply pansharpening for their applications.