An all-in-one foundation model for multimodal medical image restoration and enhancement

IF 29.8 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Luyang Cao, Zhijian Wu, Jian Zhang, Lei Qi, Yang Gao, Hairong Zheng, Yefeng Zheng, Yinghuan Shi
{"title":"An all-in-one foundation model for multimodal medical image restoration and enhancement","authors":"Luyang Cao, Zhijian Wu, Jian Zhang, Lei Qi, Yang Gao, Hairong Zheng, Yefeng Zheng, Yinghuan Shi","doi":"10.1038/s42256-026-01310-z","DOIUrl":null,"url":null,"abstract":"Medical image quality is essential for reliable clinical diagnosis and downstream artificial intelligence analysis, yet routine images are often degraded by noise, motion artefacts, low contrast, low-dose acquisition or modality-specific artefacts. Here we present AMIFound, an all-in-one foundation model for medical image enhancement and restoration across computed tomography, magnetic resonance imaging, positron emission tomography, endoscopy, ultrasound, fundus imaging and X-ray. AMIFound is trained and evaluated on 3.76 million paired high-quality and degraded images spanning 7 representative degradation patterns. A shared encoder captures modality and degradation cues, while a dynamically routed expert restoration pool adapts the enhancement pathway for each input. Across 7 modalities, AMIFound outperforms 38 task-specific and generalist baselines on full-reference image quality metrics, clinician assessment and robustness tests under combined degradations as well as on naturally degraded clinical images. Enhanced images further improve 44 disease detection tasks, tumour stage prediction and survival risk stratification in non-small-cell lung cancer, including improved individual-level prognostic ranking. These results support AMIFound as a domain-specific foundation model for improving low-quality clinical images and strengthening downstream medical artificial intelligence workflows while preserving clinically relevant information. Cao et al. present AMIFound, a foundation model that unifies medical image restoration across seven imaging modalities, delivering robust enhancement across diverse degradations and preserving clinically relevant information for diagnosis.","PeriodicalId":48533,"journal":{"name":"Nature Machine Intelligence","volume":"8 10","pages":"1596-1615"},"PeriodicalIF":29.8000,"publicationDate":"2026-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature Machine Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.nature.com/articles/s42256-026-01310-z","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Medical image quality is essential for reliable clinical diagnosis and downstream artificial intelligence analysis, yet routine images are often degraded by noise, motion artefacts, low contrast, low-dose acquisition or modality-specific artefacts. Here we present AMIFound, an all-in-one foundation model for medical image enhancement and restoration across computed tomography, magnetic resonance imaging, positron emission tomography, endoscopy, ultrasound, fundus imaging and X-ray. AMIFound is trained and evaluated on 3.76 million paired high-quality and degraded images spanning 7 representative degradation patterns. A shared encoder captures modality and degradation cues, while a dynamically routed expert restoration pool adapts the enhancement pathway for each input. Across 7 modalities, AMIFound outperforms 38 task-specific and generalist baselines on full-reference image quality metrics, clinician assessment and robustness tests under combined degradations as well as on naturally degraded clinical images. Enhanced images further improve 44 disease detection tasks, tumour stage prediction and survival risk stratification in non-small-cell lung cancer, including improved individual-level prognostic ranking. These results support AMIFound as a domain-specific foundation model for improving low-quality clinical images and strengthening downstream medical artificial intelligence workflows while preserving clinically relevant information. Cao et al. present AMIFound, a foundation model that unifies medical image restoration across seven imaging modalities, delivering robust enhancement across diverse degradations and preserving clinically relevant information for diagnosis.
多模态医学图像恢复与增强的一体化基础模型
医学图像质量对于可靠的临床诊断和下游人工智能分析至关重要,但常规图像通常会因噪声、运动伪影、低对比度、低剂量采集或模态特定伪影而降低。在这里,我们提出了AMIFound,一个一体化的医学图像增强和恢复基础模型,包括计算机断层扫描、磁共振成像、正电子发射断层扫描、内窥镜、超声、眼底成像和x射线。AMIFound在376万对高质量和退化图像上进行了训练和评估,这些图像跨越了7种代表性的退化模式。共享编码器捕获模态和退化线索,而动态路由的专家恢复池为每个输入适应增强路径。在7种模式中,AMIFound在全参考图像质量指标、临床医生评估和综合退化以及自然退化临床图像的鲁棒性测试方面优于38个特定任务和通用基线。增强的图像进一步改善了非小细胞肺癌的44种疾病检测任务、肿瘤分期预测和生存风险分层,包括提高了个体水平的预后排名。这些结果支持amiffound作为一个特定领域的基础模型,用于改善低质量的临床图像和加强下游医疗人工智能工作流程,同时保留临床相关信息。Cao等人提出了amiffound,这是一个基础模型,它统一了七种成像模式下的医学图像恢复,在不同的退化中提供强大的增强,并保留临床相关的诊断信息。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
36.90
自引率
2.10%
发文量
127
期刊介绍: Nature Machine Intelligence is a distinguished publication that presents original research and reviews on various topics in machine learning, robotics, and AI. Our focus extends beyond these fields, exploring their profound impact on other scientific disciplines, as well as societal and industrial aspects. We recognize limitless possibilities wherein machine intelligence can augment human capabilities and knowledge in domains like scientific exploration, healthcare, medical diagnostics, and the creation of safe and sustainable cities, transportation, and agriculture. Simultaneously, we acknowledge the emergence of ethical, social, and legal concerns due to the rapid pace of advancements. To foster interdisciplinary discussions on these far-reaching implications, Nature Machine Intelligence serves as a platform for dialogue facilitated through Comments, News Features, News & Views articles, and Correspondence. Our goal is to encourage a comprehensive examination of these subjects. Similar to all Nature-branded journals, Nature Machine Intelligence operates under the guidance of a team of skilled editors. We adhere to a fair and rigorous peer-review process, ensuring high standards of copy-editing and production, swift publication, and editorial independence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书