While cancer cases continue to increase and diagnosis, prognosis and treatment become more digital, AI-assisted cancer patient care, in particular in the pathology daily practice, remains scarce and rudimentary. In this chapter, we focus on reducing the gap between the AI technologies' outcomes and the way pathologists interpret the content of a histology image. We propose to leverage a semantic approach for both representing the relevant histology images and learning from them, thus mapping content to functionality and phenotype, that we call HistoCartography. We construct HierArchical Cell-to-Tissue (HACT) graphs to represent the content, leverage graph neural networks to learn from the HACT representations and respective graph explainers to indicate the image content that drives the AI-technologies' outputs. We further introduce a post-hoc graph explainer to quantitatively and qualitatively map the decision driving histology image content to measurable, pathologically understandable concepts. We test and validate the proposed approach by classifying seven breast carcinoma subtypes and demonstrate its power with respect to classification accuracy but moreover with respect to its ability to correlate to pathological knowledge and acceptance by domain experts, as validated by three independent pathologists from different institutions.

Graph representation learning & explainability in breast cancer pathology: bridging the gap between AI and pathology practice

N Brancati;M Frucci;D Riccio;
2022

Abstract

While cancer cases continue to increase and diagnosis, prognosis and treatment become more digital, AI-assisted cancer patient care, in particular in the pathology daily practice, remains scarce and rudimentary. In this chapter, we focus on reducing the gap between the AI technologies' outcomes and the way pathologists interpret the content of a histology image. We propose to leverage a semantic approach for both representing the relevant histology images and learning from them, thus mapping content to functionality and phenotype, that we call HistoCartography. We construct HierArchical Cell-to-Tissue (HACT) graphs to represent the content, leverage graph neural networks to learn from the HACT representations and respective graph explainers to indicate the image content that drives the AI-technologies' outputs. We further introduce a post-hoc graph explainer to quantitatively and qualitatively map the decision driving histology image content to measurable, pathologically understandable concepts. We test and validate the proposed approach by classifying seven breast carcinoma subtypes and demonstrate its power with respect to classification accuracy but moreover with respect to its ability to correlate to pathological knowledge and acceptance by domain experts, as validated by three independent pathologists from different institutions.
2022
Istituto di Calcolo e Reti ad Alte Prestazioni - ICAR
978-1-80061-140-5
digital pathology
graph
breast cancer
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14243/442665
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact