Artificial Intelligence systems often adopt machine learning models encoding complex algorithms with potentially unknown behavior. As the application of these "black box" models grows, it is our responsibility to understand their inner working and formulate them in human-understandable explanations. To this end, we propose a rule-based model-agnostic explanation method that follows a local-to-global schema: it generalizes a global explanation summarizing the decision logic of a black box starting from the local explanations of single predicted instances. We define a scoring system based on a rule relevance score to extract global explanations from a set of local explanations in the form of decision rules. Experiments on several datasets and black boxes show the stability, and low complexity of the global explanations provided by the proposed solution in comparison with baselines and state-of-the-art global explainers.

Global explanations with local scoring

Guidotti R;
2020

Abstract

Artificial Intelligence systems often adopt machine learning models encoding complex algorithms with potentially unknown behavior. As the application of these "black box" models grows, it is our responsibility to understand their inner working and formulate them in human-understandable explanations. To this end, we propose a rule-based model-agnostic explanation method that follows a local-to-global schema: it generalizes a global explanation summarizing the decision logic of a black box starting from the local explanations of single predicted instances. We define a scoring system based on a rule relevance score to extract global explanations from a set of local explanations in the form of decision rules. Experiments on several datasets and black boxes show the stability, and low complexity of the global explanations provided by the proposed solution in comparison with baselines and state-of-the-art global explainers.
2020
Istituto di Scienza e Tecnologie dell'Informazione "Alessandro Faedo" - ISTI
Inglese
Cellier P., Driessens K.
Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2019. Communications in Computer and Information Science
Joint European Conference on Machine Learning and Knowledge Discovery in Databases - ECML PKDD 2019
159
171
978-3-030-43822-7
https://link.springer.com/chapter/10.1007/978-3-030-43823-4_14
Sì, ma tipo non specificato
16-20 September, 2019
Würzburg, Germany
Decision system
Explainable AI
Rule-based explainer
progetto europeo da aggiungere AI4EU - A European AI On Demand Platform and Ecosystem, G.A. 825619
4
reserved
Setzu, M; Guidotti, R; Monreale, A; Turini, F
273
info:eu-repo/semantics/conferenceObject
04 Contributo in convegno::04.01 Contributo in Atti di convegno
   SoBigData Research Infrastructure
   SoBigData
   H2020
   654024

   Big Data for Mobility Tracking Knowledge Extraction in Urban Areas
   Track and Know
   H2020
   780754

   PROmoting integrity in the use of RESearch results
   PRO-RES
   H2020
   788352

   A European AI On Demand Platform and Ecosystem
   AI4EU
   H2020
   825619
File in questo prodotto:
File Dimensione Formato  
prod_424675-doc_151461.pdf

non disponibili

Descrizione: Global explanations with local scoring
Tipologia: Versione Editoriale (PDF)
Dimensione 1.24 MB
Formato Adobe PDF
1.24 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/407885
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 10
  • ???jsp.display-item.citation.isi??? 5
social impact