Jianye Jia, Yue Kang, Jiahao Wang, Fan Bai, Lei Han, Yantao Niu
{"title":"Attention mechanism-based multi-parametric MRI ensemble model for predicting tumor budding grade in rectal cancer patients","authors":"Jianye Jia, Yue Kang, Jiahao Wang, Fan Bai, Lei Han, Yantao Niu","doi":"10.1007/s00261-025-04886-z","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><p>To develop and validate a deep learning-based feature ensemble model using multiparametric magnetic resonance imaging (MRI) for predicting tumor budding (TB) grading in patients with rectal cancer (RC).</p><h3>Methods</h3><p>A retrospective cohort of 458 patients with pathologically confirmed rectal cancer (RC) from three institutions was included. Among them, 355 patients from Center 1 were divided into two groups at a 7:3 ratio: the training cohort (<i>n</i> = 248) and the internal validation cohort (<i>n</i> = 107). An additional 103 patients from two other centers served as the external validation cohort. Deep learning models were constructed for T2-weighted imaging (T2WI) and diffusion-weighted imaging (DWI) based on the CrossFormer architecture, and deep learning features were extracted. Subsequently, a feature ensemble module based on the attention mechanism of Transformer was used to capture spatial interactions between different imaging sequences, creating a multiparametric ensemble model. The predictive performance of each model was evaluated using the area under the curve (AUC), calibration curves, and decision curve analysis (DCA).</p><h3>Results</h3><p>The deep learning model based on T2WI achieved AUC values of 0.789 (95% CI: 0.680–0.900) and 0.720 (95% CI: 0.591–0.849) in the internal and external validation cohorts, respectively. The deep learning model based on DWI had AUC values of 0.806 (95% CI: 0.705–0.908) and 0.772 (95% CI: 0.657–0.887) in the internal and external validation cohorts, respectively. The multiparametric ensemble model demonstrated superior performance, with AUC values of 0.868 (95% CI: 0.775–0.960) in the internal validation cohort and 0.839 (95% CI: 0.743–0.935) in the external validation cohort. DeLong test showed that the differences in AUC values among the models were not statistically significant in both the internal and external test sets (<i>P</i> > 0.05). The DCA curve demonstrated that within the 10–80% threshold range, the fusion model provided significantly higher clinical net benefit compared to other models.</p><h3>Conclusion</h3><p>Compared to single-sequence deep learning models, the attention mechanism-based multiparametric MRI fusion model enables more effective individualized prediction of TB grading in RC patients. It offers valuable guidance for treatment selection and prognostic evaluation while providing imaging-based support for personalized postoperative follow-up adjustments.</p><h3>Graphical abstract</h3><div><figure><div><div><picture><source><img></source></picture></div></div></figure></div></div>","PeriodicalId":7126,"journal":{"name":"Abdominal Radiology","volume":"50 10","pages":"4483 - 4494"},"PeriodicalIF":2.2000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Abdominal Radiology","FirstCategoryId":"3","ListUrlMain":"https://link.springer.com/article/10.1007/s00261-025-04886-z","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
To develop and validate a deep learning-based feature ensemble model using multiparametric magnetic resonance imaging (MRI) for predicting tumor budding (TB) grading in patients with rectal cancer (RC).
Methods
A retrospective cohort of 458 patients with pathologically confirmed rectal cancer (RC) from three institutions was included. Among them, 355 patients from Center 1 were divided into two groups at a 7:3 ratio: the training cohort (n = 248) and the internal validation cohort (n = 107). An additional 103 patients from two other centers served as the external validation cohort. Deep learning models were constructed for T2-weighted imaging (T2WI) and diffusion-weighted imaging (DWI) based on the CrossFormer architecture, and deep learning features were extracted. Subsequently, a feature ensemble module based on the attention mechanism of Transformer was used to capture spatial interactions between different imaging sequences, creating a multiparametric ensemble model. The predictive performance of each model was evaluated using the area under the curve (AUC), calibration curves, and decision curve analysis (DCA).
Results
The deep learning model based on T2WI achieved AUC values of 0.789 (95% CI: 0.680–0.900) and 0.720 (95% CI: 0.591–0.849) in the internal and external validation cohorts, respectively. The deep learning model based on DWI had AUC values of 0.806 (95% CI: 0.705–0.908) and 0.772 (95% CI: 0.657–0.887) in the internal and external validation cohorts, respectively. The multiparametric ensemble model demonstrated superior performance, with AUC values of 0.868 (95% CI: 0.775–0.960) in the internal validation cohort and 0.839 (95% CI: 0.743–0.935) in the external validation cohort. DeLong test showed that the differences in AUC values among the models were not statistically significant in both the internal and external test sets (P > 0.05). The DCA curve demonstrated that within the 10–80% threshold range, the fusion model provided significantly higher clinical net benefit compared to other models.
Conclusion
Compared to single-sequence deep learning models, the attention mechanism-based multiparametric MRI fusion model enables more effective individualized prediction of TB grading in RC patients. It offers valuable guidance for treatment selection and prognostic evaluation while providing imaging-based support for personalized postoperative follow-up adjustments.
期刊介绍:
Abdominal Radiology seeks to meet the professional needs of the abdominal radiologist by publishing clinically pertinent original, review and practice related articles on the gastrointestinal and genitourinary tracts and abdominal interventional and radiologic procedures. Case reports are generally not accepted unless they are the first report of a new disease or condition, or part of a special solicited section.
Reasons to Publish Your Article in Abdominal Radiology:
· Official journal of the Society of Abdominal Radiology (SAR)
· Published in Cooperation with:
European Society of Gastrointestinal and Abdominal Radiology (ESGAR)
European Society of Urogenital Radiology (ESUR)
Asian Society of Abdominal Radiology (ASAR)
· Efficient handling and Expeditious review
· Author feedback is provided in a mentoring style
· Global readership
· Readers can earn CME credits