SpectralSWIN: a spectral-swin transformer network for hyperspectral image classification


AYAS S., Tunc-Gormus E.

INTERNATIONAL JOURNAL OF REMOTE SENSING, cilt.43, sa.11, ss.4025-4044, 2022 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 43 Sayı: 11
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1080/01431161.2022.2105668
  • Dergi Adı: INTERNATIONAL JOURNAL OF REMOTE SENSING
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Aerospace Database, Applied Science & Technology Source, Aqualine, Aquatic Science & Fisheries Abstracts (ASFA), Artic & Antarctic Regions, BIOSIS, CAB Abstracts, Communication Abstracts, Compendex, Computer & Applied Sciences, Environment Index, Geobase, INSPEC, Metadex, Pollution Abstracts, Public Affairs Index, Veterinary Science Database, DIALNET, Civil Engineering Abstracts
  • Sayfa Sayıları: ss.4025-4044
  • Karadeniz Teknik Üniversitesi Adresli: Evet

Özet

Hyperspectral image (HSI) classification has received extensive attention by the development of deep learning and has achieved great success. However, most of the deep learning-based approaches tend to extract features of spatial content by disrupting spectral information or to extract sequential spectral features in short-range context. On the other hand, Transformers-based models address this problem by learning long-range relationship. This study introduces a novel spectral-swin transformer (SpectralSWIN) network. The proposed network effectively projects the HSI data from spectral characteristics into spatial and spectral feature representation. Specifically, SpectralSWIN network makes use of a newly proposed swin-spectral module (SSM) for processing the spatial and spectral features concurrently. As far as we know, this is the first time that a transformer backbone designed for vision domain has been proposed for HSI classification. Extensive experiments conducted on two different HSI prove the superiority and effectiveness of the proposed method over the state-of-the-art methods in terms of both quantitative and visual evaluations.