Radiopathomic Graph Deep Learning for Multiscale Spatial-Contextual Modeling of Intratumoral Heterogeneity to Predict Breast Cancer Response to Neoadjuvant Therapy.

Abstract

Purpose To develop an explainable radiopathomic graph deep learning (RPGDL) system for multiscale spatial-contextual modeling of intratumoral heterogeneity and evaluate its performance for the prediction of pathologic complete response (pCR) to neoadjuvant therapy in breast cancer. Materials and Methods The RPGDL system was developed from dual-center retrospective analysis of patients with biopsy-proven invasive breast cancer (May 2018-August 2024). For each tumor, individual radiomic and pathomic graphs were generated from pretherapeutic MRI and hematoxylin-eosin-stained biopsy slide images, respectively. These graphs were then processed by three distinct graph neural networks (GNNs): radiomic, pathomic, and radiopathomic. GNN performance was assessed with the area under the receiver operating characteristic curve (AUC), net reclassification index (NRI), and integrated discrimination improvement (IDI). A multifaceted approach was used to explain the GNNs' predictions. Results The training set included 582 (mean age, 52 years ± 9 [SD]) patients and the external test set 468 (50 years ± 10) patients from centers 1 and 2, respectively. The radiomic GNN achieved AUCs of 0.89 (95% CI: 0.85, 0.93) in the training set and 0.84 (95% CI: 0.80, 0.89) in the external test set; the pathomic GNN achieved AUCs of 0.87 (95% CI: 0.83, 0.91) in the training set and 0.83 (95% CI: 0.78, 0.88) in the external test set, with no significant difference between them (P > .05). The radiopathomic GNN outperformed both single-modality GNNs (training set: AUC, 0.95 [95% CI: 0.92, 0.98]; external test set: AUC, 0.91 [95% CI: 0.87, 0.94]; P < .05; NRI and IDI confirmed). Pathomic graphs dominated probability increases for pCR predictions, while radiomic graphs drove probability decreases for non-pCR predictions. Multifaceted analyses verified GNNs' explainability. Conclusion The developed RPGDL system enabled multiscale spatial-contextual intratumoral heterogeneity modeling for high-performance, explainable prediction of pCR to neoadjuvant therapy in breast cancer. Keywords: Dynamic Contrast-enhanced MRI, Breast, Tumor Response, Radiology-Pathology Integration, Prognosis, Principal Component Analysis, Perception, Supervised Learning, Reconstruction Algorithm Supplemental material is available for this article. © RSNA, 2026.