Leveraging Multimodal Foundation Models in Biliary Tract Cancer Research.

IF 2.2 4区 医学 Q2 RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
Yashbir Singh, Jesper B Andersen, Quincy A Hathaway, Diana V Vera-Garcia, Varekan Keishing, Sudhakar K Venkatesh, Sara Salehi, Davide Povero, Michael B Wallace, Gregory J Gores, Yujia Wei, Natally Horvat, Bradley J Erickson, Emilio Quaia
{"title":"Leveraging Multimodal Foundation Models in Biliary Tract Cancer Research.","authors":"Yashbir Singh, Jesper B Andersen, Quincy A Hathaway, Diana V Vera-Garcia, Varekan Keishing, Sudhakar K Venkatesh, Sara Salehi, Davide Povero, Michael B Wallace, Gregory J Gores, Yujia Wei, Natally Horvat, Bradley J Erickson, Emilio Quaia","doi":"10.3390/tomography11090096","DOIUrl":null,"url":null,"abstract":"<p><p>This review explores how multimodal foundation models (MFMs) are transforming biliary tract cancer (BTC) research. BTCs are aggressive malignancies with poor prognosis, presenting unique challenges due to difficult diagnostic methods, molecular complexity, and rarity. Importantly, intrahepatic cholangiocarcinoma (iCCA), perihilar cholangiocarcinoma (pCCA), and distal bile duct cholangiocarcinoma (dCCA) represent fundamentally distinct clinical entities, with iCCA presenting as mass-forming lesions amenable to biopsy and targeted therapies, while pCCA manifests as infiltrative bile duct lesions with challenging diagnosis and primarily palliative management approaches. MFMs offer potential to advance research by integrating radiological images, histopathology, multi-omics profiles, and clinical data into unified computational frameworks, with applications tailored to these distinct BTC subtypes. Key applications include enhanced biomarker discovery that identifies previously unrecognizable cross-modal patterns, potential for improving currently limited diagnostic accuracy-though validation in BTC-specific cohorts remains essential-accelerated drug repurposing, and advanced patient stratification for personalized treatment. Despite promising results, challenges such as data scarcity, high computational demands, and clinical workflow integration remain to be addressed. Future research should focus on standardized data protocols, architectural innovations, and prospective validation studies. The integration of artificial intelligence (AI)-based methodologies offers new solutions for these historically challenging malignancies. However, current evidence for BTC-specific applications remains largely theoretical, with most studies limited to proof-of-concept designs or related cancer types. Comprehensive clinical validation studies and prospective trials demonstrating patient benefit are essential prerequisites for clinical implementation. The timeline for evidence-based clinical adoption likely extends 7-10 years, contingent on successful completion of validation studies addressing current evidence gaps.</p>","PeriodicalId":51330,"journal":{"name":"Tomography","volume":"11 9","pages":""},"PeriodicalIF":2.2000,"publicationDate":"2025-08-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12473628/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Tomography","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3390/tomography11090096","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0

Abstract

This review explores how multimodal foundation models (MFMs) are transforming biliary tract cancer (BTC) research. BTCs are aggressive malignancies with poor prognosis, presenting unique challenges due to difficult diagnostic methods, molecular complexity, and rarity. Importantly, intrahepatic cholangiocarcinoma (iCCA), perihilar cholangiocarcinoma (pCCA), and distal bile duct cholangiocarcinoma (dCCA) represent fundamentally distinct clinical entities, with iCCA presenting as mass-forming lesions amenable to biopsy and targeted therapies, while pCCA manifests as infiltrative bile duct lesions with challenging diagnosis and primarily palliative management approaches. MFMs offer potential to advance research by integrating radiological images, histopathology, multi-omics profiles, and clinical data into unified computational frameworks, with applications tailored to these distinct BTC subtypes. Key applications include enhanced biomarker discovery that identifies previously unrecognizable cross-modal patterns, potential for improving currently limited diagnostic accuracy-though validation in BTC-specific cohorts remains essential-accelerated drug repurposing, and advanced patient stratification for personalized treatment. Despite promising results, challenges such as data scarcity, high computational demands, and clinical workflow integration remain to be addressed. Future research should focus on standardized data protocols, architectural innovations, and prospective validation studies. The integration of artificial intelligence (AI)-based methodologies offers new solutions for these historically challenging malignancies. However, current evidence for BTC-specific applications remains largely theoretical, with most studies limited to proof-of-concept designs or related cancer types. Comprehensive clinical validation studies and prospective trials demonstrating patient benefit are essential prerequisites for clinical implementation. The timeline for evidence-based clinical adoption likely extends 7-10 years, contingent on successful completion of validation studies addressing current evidence gaps.

Abstract Image

Abstract Image

Abstract Image

利用多模态基础模型进行胆道肿瘤研究。
本文综述了多模态基础模型(MFMs)如何改变胆道癌(BTC)的研究。btc是侵袭性恶性肿瘤,预后差,由于诊断方法困难、分子复杂性和罕见性,提出了独特的挑战。重要的是,肝内胆管癌(iCCA)、肝门周围胆管癌(pCCA)和远端胆管癌(dCCA)代表着根本不同的临床实体,iCCA表现为肿块形成病变,适合活检和靶向治疗,而pCCA表现为浸润性胆管病变,具有挑战性的诊断和主要的姑息治疗方法。MFMs通过将放射图像、组织病理学、多组学资料和临床数据整合到统一的计算框架中,并针对这些不同的BTC亚型定制应用程序,为推进研究提供了潜力。关键应用包括增强生物标志物发现,识别以前无法识别的跨模态模式,提高目前有限的诊断准确性的潜力(尽管在btc特异性队列中进行验证仍然很重要),加速药物再利用,以及先进的患者分层以进行个性化治疗。尽管取得了可喜的成果,但数据稀缺、高计算需求和临床工作流程集成等挑战仍有待解决。未来的研究应该集中在标准化数据协议、架构创新和前瞻性验证研究上。基于人工智能(AI)的方法的整合为这些具有历史挑战性的恶性肿瘤提供了新的解决方案。然而,目前关于比特币特定应用的证据在很大程度上仍然是理论上的,大多数研究仅限于概念验证设计或相关的癌症类型。全面的临床验证研究和前瞻性试验证明患者受益是临床实施的必要先决条件。基于证据的临床应用时间表可能会延长7-10年,这取决于能否成功完成针对当前证据差距的验证研究。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Tomography
Tomography Medicine-Radiology, Nuclear Medicine and Imaging
CiteScore
2.70
自引率
10.50%
发文量
222
期刊介绍: TomographyTM publishes basic (technical and pre-clinical) and clinical scientific articles which involve the advancement of imaging technologies. Tomography encompasses studies that use single or multiple imaging modalities including for example CT, US, PET, SPECT, MR and hyperpolarization technologies, as well as optical modalities (i.e. bioluminescence, photoacoustic, endomicroscopy, fiber optic imaging and optical computed tomography) in basic sciences, engineering, preclinical and clinical medicine. Tomography also welcomes studies involving exploration and refinement of contrast mechanisms and image-derived metrics within and across modalities toward the development of novel imaging probes for image-based feedback and intervention. The use of imaging in biology and medicine provides unparalleled opportunities to noninvasively interrogate tissues to obtain real-time dynamic and quantitative information required for diagnosis and response to interventions and to follow evolving pathological conditions. As multi-modal studies and the complexities of imaging technologies themselves are ever increasing to provide advanced information to scientists and clinicians. Tomography provides a unique publication venue allowing investigators the opportunity to more precisely communicate integrated findings related to the diverse and heterogeneous features associated with underlying anatomical, physiological, functional, metabolic and molecular genetic activities of normal and diseased tissue. Thus Tomography publishes peer-reviewed articles which involve the broad use of imaging of any tissue and disease type including both preclinical and clinical investigations. In addition, hardware/software along with chemical and molecular probe advances are welcome as they are deemed to significantly contribute towards the long-term goal of improving the overall impact of imaging on scientific and clinical discovery.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信