Multi-modal Volumetric Concept Activation to Explain Detection and Classification of Metastatic Prostate Cancer on PSMA-PET/CT

R. C.J. Kraaijveld, M. E.P. Philippens, W. S.C. Eppinga, I. M. Jürgenliemk-Schulz, K. G.A. Gilhuijs, P. S. Kroon, B. H.M. van der Velden*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Explainable artificial intelligence (XAI) is increasingly used to analyze the behavior of neural networks. Concept activation uses human-interpretable concepts to explain neural network behavior. This study aimed at assessing the feasibility of regression concept activation to explain detection and classification of multi-modal volumetric data. Proof-of-concept was demonstrated in metastatic prostate cancer patients imaged with positron emission tomography/computed tomography (PET/CT). Multi-modal volumetric concept activation was used to provide global and local explanations. Sensitivity was 80% at 1.78 false positive per patient. Global explanations showed that detection focused on CT for anatomical location and on PET for its confidence in the detection. Local explanations showed promise to aid in distinguishing true positives from false positives. Hence, this study demonstrated feasibility to explain detection and classification of multi-modal volumetric data using regression concept activation.

Original languageEnglish
Title of host publicationInterpretability of Machine Intelligence in Medical Image Computing - 5th International Workshop, iMIMIC 2022, Held in Conjunction with MICCAI 2022, Proceedings
EditorsMauricio Reyes, Pedro Henriques Abreu, Jaime Cardoso
PublisherSpringer Science and Business Media Deutschland GmbH
Pages82-92
Number of pages11
ISBN (Print)9783031179754
DOIs
Publication statusPublished - 2022
Event5th International Workshop on Interpretability of Machine Intelligence in Medical Image Computing, iMIMIC 2022, held in conjunction with the 25th International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2022 - Singapore, Singapore
Duration: 22 Sept 202222 Sept 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13611 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th International Workshop on Interpretability of Machine Intelligence in Medical Image Computing, iMIMIC 2022, held in conjunction with the 25th International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2022
Country/TerritorySingapore
CitySingapore
Period22/09/2222/09/22

Keywords

  • Explainable artificial intelligence
  • Interpretable deep learning
  • Medical image analysis
  • PET/CT
  • Prostate cancer

Fingerprint

Dive into the research topics of 'Multi-modal Volumetric Concept Activation to Explain Detection and Classification of Metastatic Prostate Cancer on PSMA-PET/CT'. Together they form a unique fingerprint.

Cite this