Skip to main navigation Skip to search Skip to main content

UM–ProtoShare: UNet-Guided, Multi-scale Shared Prototypes for Interpretable Brain Tumour Classification Using Multi-sequence 3D MRI

Research output: Contribution to journalConference proceedings published in a journalpeer-review

1 Downloads (Pure)

Abstract

Deep learning shows strong promise in brain tumour classification using Magnetic Resonance Imaging (MRI), although limited interpretability constrains clinical translation. Most interpretability methods are post-hoc and yield visual attribution maps that are only weakly connected to the decision process. Clinicians prefer decisions built from evidence they can recognise and verify on MRI, rather than post-hoc explanations. Case-based models embed reasoning by comparing image evidence with learned prototypes, yielding “this looks like that” rationales at decision time and mirroring clinical reasoning. Building on this paradigm, we introduce UM–ProtoShare, which compares the input multi-sequence 3D brain MRI with a bank of shared, class-agnostic, multi-scale prototypes for pre-operative glioma grading. It returns not only a label, but a set of prototype matches that highlight where the model found support for its prediction. UM–ProtoShare uses a 3D ResNet-152 encoder, a lightweight UNet–style decoder with gated encoder–decoder fusions, and a normalised soft-masked mapping module to align and highlight prototype evidence on MRI. On BraTS-2020, ablations show additive benefits from the normalised mapping module, prototype sharing, multi-scale prototypes, and the decoder with gated fusions. Varying the allocation of prototypes across scales identifies a balanced accuracy–interpretability configuration that closely approaches a strong 3D ResNet-152 in classification performance (Balanced Accuracy: 88.40 ± 2.80; 1.48 percentage points lower) while delivering more faithful and spatially precise evidence than prior case-based models, with Activation Precision (AP) 88.72 ± 1.60 (+11.0% vs MProtoNet; +4.0% vs MAProtoNet) and Incremental Deletion Score (IDS) 5.10 ± 1.30 (lower is better, −32.3% vs MProtoNet, −25.3% vs MAProtoNet).

Original languageEnglish
Pages (from-to)637-669
Number of pages33
JournalProceedings of Machine Learning Research
Volume315
Publication statusPublished - 8 Jul 2026
Event9th International Conference on Medical Imaging with Deep Learning, MIDL 2026 - Chientan, Taiwan, Province of China
Duration: 8 Jul 202610 Jul 2026

ASJC Scopus subject areas

  • Software
  • Control and Systems Engineering
  • Statistics and Probability
  • Artificial Intelligence

Keywords

  • Brain Tumour Classification
  • Case-based Models
  • Interpretable Deep Learning
  • Multi-sequence 3D MRI

Fingerprint

Dive into the research topics of 'UM–ProtoShare: UNet-Guided, Multi-scale Shared Prototypes for Interpretable Brain Tumour Classification Using Multi-sequence 3D MRI'. Together they form a unique fingerprint.

Cite this