Out-of-distribution detection has become an important theme in machine learning (ML) field, since the recognition of unseen data either "similar" or not (in- or out-of-distribution) to the ones the ML system has been trained on may lead to potentially fatal conse- quences. Operational data compliance with the training data has to be verified by the data analyst, who must also understand, in operation, if the autonomous decision-making is still safe or not. In this paper, we study an out-of-distribution (OoD) detection approach based on a rule- based eXplainable Artificial Intelligence (XAI) model. Specifically, the method relies on an innovative metric, i.e., the weighted mutual infor- mation, able to capture the different way decision rules are used in case of in- and OoD data.

Weighted Mutual Information for Out-Of-Distribution Detection

Giacomo De Bernardi;Sara Narteni;Enrico Cambiaso;Marco Muselli;Maurizio Mongelli
2023

Abstract

Out-of-distribution detection has become an important theme in machine learning (ML) field, since the recognition of unseen data either "similar" or not (in- or out-of-distribution) to the ones the ML system has been trained on may lead to potentially fatal conse- quences. Operational data compliance with the training data has to be verified by the data analyst, who must also understand, in operation, if the autonomous decision-making is still safe or not. In this paper, we study an out-of-distribution (OoD) detection approach based on a rule- based eXplainable Artificial Intelligence (XAI) model. Specifically, the method relies on an innovative metric, i.e., the weighted mutual infor- mation, able to capture the different way decision rules are used in case of in- and OoD data.
2023
Inglese
First World Conference on Explainable Artificial Intelligence (xAI 2023)
318
331
14
https://doi.org/10.1007/978-3-031-44070-0_16
Springer
Cham Heidelberg New York Dordrecht London
SVIZZERA
Sì, ma tipo non specificato
26-28/10/2023
Lisbona
Out-of-distribution detection
eXplainable AI
mutual information
open data
5
none
De Bernardi, Giacomo; Narteni, Sara; Cambiaso, Enrico; Muselli, Marco; Mongelli, Maurizio
273
info:eu-repo/semantics/conferenceObject
04 Contributo in convegno::04.01 Contributo in Atti di convegno
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/436523
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact