Several Remote Sensing applications in Hyperspectral Imaging rely on Artificial Intelligence techniques, particularly Deep Neural Networks, which often outperform other algorithms. However, despite their effectiveness, these techniques are considered opaque for the non-linearity of the underlying model, making a conscious results interpretation difficult even for experts in the application field. The present work aims to describe the results of our experiments toward Explainable Artificial Intelligence techniques for hyperspectral remote sensing image classification in Edge Computing environments. The proposed technique extends the traditional 2D Gradient-weighted Class Activation Mapping (Grad-CAM) to 3D Convolutional Neural Networks. Moreover, we use spectral-cumulative Grad-CAM and class probability as complementary methods. The experimental results confirm that the observer can interpret the choices made within neural network layers by visualizing the activation volumes provided by the proposed method.

Towards explainable AI for hyperspectral image classification in Edge Computing environments

De Lucia G.;Romano D.
2022

Abstract

Several Remote Sensing applications in Hyperspectral Imaging rely on Artificial Intelligence techniques, particularly Deep Neural Networks, which often outperform other algorithms. However, despite their effectiveness, these techniques are considered opaque for the non-linearity of the underlying model, making a conscious results interpretation difficult even for experts in the application field. The present work aims to describe the results of our experiments toward Explainable Artificial Intelligence techniques for hyperspectral remote sensing image classification in Edge Computing environments. The proposed technique extends the traditional 2D Gradient-weighted Class Activation Mapping (Grad-CAM) to 3D Convolutional Neural Networks. Moreover, we use spectral-cumulative Grad-CAM and class probability as complementary methods. The experimental results confirm that the observer can interpret the choices made within neural network layers by visualizing the activation volumes provided by the proposed method.
2022
Istituto di Calcolo e Reti ad Alte Prestazioni - ICAR
Convolutional neural networks
Data visualization
Edge computing
Explainable artificial intelligence
Hyperspectral imaging
Image classification
Remote sensing
File in questo prodotto:
File Dimensione Formato  
21_XAI-Hyper.pdf

solo utenti autorizzati

Tipologia: Versione Editoriale (PDF)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 4.5 MB
Formato Adobe PDF
4.5 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/415373
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 32
  • ???jsp.display-item.citation.isi??? 23
social impact