While cancer cases continue to increase and diagnosis, prognosis and treatment become more digital, AI-assisted cancer patient care, in particular in the pathology daily practice, remains scarce and rudimentary. In this chapter, we focus on reducing the gap between the AI technologies' outcomes and the way pathologists interpret the content of a histology image. We propose to leverage a semantic approach for both representing the relevant histology images and learning from them, thus mapping content to functionality and phenotype, that we call HistoCartography. We construct HierArchical Cell-to-Tissue (HACT) graphs to represent the content, leverage graph neural networks to learn from the HACT representations and respective graph explainers to indicate the image content that drives the AI-technologies' outputs. We further introduce a post-hoc graph explainer to quantitatively and qualitatively map the decision driving histology image content to measurable, pathologically understandable concepts. We test and validate the proposed approach by classifying seven breast carcinoma subtypes and demonstrate its power with respect to classification accuracy but moreover with respect to its ability to correlate to pathological knowledge and acceptance by domain experts, as validated by three independent pathologists from different institutions.

Graph representation learning & explainability in breast cancer pathology: bridging the gap between AI and pathology practice

N Brancati;M Frucci;D Riccio;
2022

Abstract

While cancer cases continue to increase and diagnosis, prognosis and treatment become more digital, AI-assisted cancer patient care, in particular in the pathology daily practice, remains scarce and rudimentary. In this chapter, we focus on reducing the gap between the AI technologies' outcomes and the way pathologists interpret the content of a histology image. We propose to leverage a semantic approach for both representing the relevant histology images and learning from them, thus mapping content to functionality and phenotype, that we call HistoCartography. We construct HierArchical Cell-to-Tissue (HACT) graphs to represent the content, leverage graph neural networks to learn from the HACT representations and respective graph explainers to indicate the image content that drives the AI-technologies' outputs. We further introduce a post-hoc graph explainer to quantitatively and qualitatively map the decision driving histology image content to measurable, pathologically understandable concepts. We test and validate the proposed approach by classifying seven breast carcinoma subtypes and demonstrate its power with respect to classification accuracy but moreover with respect to its ability to correlate to pathological knowledge and acceptance by domain experts, as validated by three independent pathologists from different institutions.
2022
Istituto di Calcolo e Reti ad Alte Prestazioni - ICAR
Inglese
Ralf Huss and Michael Grunkin
Huss, Ralf; Grunkin, Michael.
Artificial Intelligence Applications in Human Pathology
243
285
43
978-1-80061-140-5
https://www.worldscientific.com/doi/abs/10.1142/9781800611399_0010
https://books.google.it/books?hl=en&lr=&id=5gtqEAAAQBAJ&oi=fnd&pg=PA243&dq=info:178xJ35psC4J:scholar.google.com&ots=8UCLqNGZMP&sig=MKq9Sa5_ftMl-uZUgG5AOWIedbU&redir_esc=y#v=onepage&q&f=false
World Scientific Publishing
Londra
REGNO UNITO DI GRAN BRETAGNA
Esperti anonimi
digital pathology
graph
breast cancer
Internazionale
Elettronico
12
02 Contributo in Volume::02.01 Contributo in volume (Capitolo o Saggio)
268
restricted
Pati, P; Jaume, G; Foncubiertarodriguez, A; Feroce, F; Scognamiglio, G; M Anniciello, A; Brancati, N; Frucci, M; Riccio, D; Thiran, Jp; Goksel, O; Gab...espandi
info:eu-repo/semantics/bookPart
File in questo prodotto:
File Dimensione Formato  
prod_463064-doc_188375.pdf

solo utenti autorizzati

Descrizione: Graph representation learning & explainability in breast cancer pathology: bridging the gap between AI and pathology practice
Tipologia: Versione Editoriale (PDF)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 2.92 MB
Formato Adobe PDF
2.92 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/442665
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact