Luyang Cao, Zhijian Wu, Jian Zhang, Lei Qi, Yang Gao, Hairong Zheng, Yefeng Zheng, Yinghuan Shi
{"title":"An all-in-one foundation model for multimodal medical image restoration and enhancement","authors":"Luyang Cao, Zhijian Wu, Jian Zhang, Lei Qi, Yang Gao, Hairong Zheng, Yefeng Zheng, Yinghuan Shi","doi":"10.1038/s42256-026-01310-z","DOIUrl":null,"url":null,"abstract":"Medical image quality is essential for reliable clinical diagnosis and downstream artificial intelligence analysis, yet routine images are often degraded by noise, motion artefacts, low contrast, low-dose acquisition or modality-specific artefacts. Here we present AMIFound, an all-in-one foundation model for medical image enhancement and restoration across computed tomography, magnetic resonance imaging, positron emission tomography, endoscopy, ultrasound, fundus imaging and X-ray. AMIFound is trained and evaluated on 3.76 million paired high-quality and degraded images spanning 7 representative degradation patterns. A shared encoder captures modality and degradation cues, while a dynamically routed expert restoration pool adapts the enhancement pathway for each input. Across 7 modalities, AMIFound outperforms 38 task-specific and generalist baselines on full-reference image quality metrics, clinician assessment and robustness tests under combined degradations as well as on naturally degraded clinical images. Enhanced images further improve 44 disease detection tasks, tumour stage prediction and survival risk stratification in non-small-cell lung cancer, including improved individual-level prognostic ranking. These results support AMIFound as a domain-specific foundation model for improving low-quality clinical images and strengthening downstream medical artificial intelligence workflows while preserving clinically relevant information. Cao et al. present AMIFound, a foundation model that unifies medical image restoration across seven imaging modalities, delivering robust enhancement across diverse degradations and preserving clinically relevant information for diagnosis.","PeriodicalId":48533,"journal":{"name":"Nature Machine Intelligence","volume":"8 10","pages":"1596-1615"},"PeriodicalIF":29.8000,"publicationDate":"2026-10-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Nature Machine Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.nature.com/articles/s42256-026-01310-z","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
Medical image quality is essential for reliable clinical diagnosis and downstream artificial intelligence analysis, yet routine images are often degraded by noise, motion artefacts, low contrast, low-dose acquisition or modality-specific artefacts. Here we present AMIFound, an all-in-one foundation model for medical image enhancement and restoration across computed tomography, magnetic resonance imaging, positron emission tomography, endoscopy, ultrasound, fundus imaging and X-ray. AMIFound is trained and evaluated on 3.76 million paired high-quality and degraded images spanning 7 representative degradation patterns. A shared encoder captures modality and degradation cues, while a dynamically routed expert restoration pool adapts the enhancement pathway for each input. Across 7 modalities, AMIFound outperforms 38 task-specific and generalist baselines on full-reference image quality metrics, clinician assessment and robustness tests under combined degradations as well as on naturally degraded clinical images. Enhanced images further improve 44 disease detection tasks, tumour stage prediction and survival risk stratification in non-small-cell lung cancer, including improved individual-level prognostic ranking. These results support AMIFound as a domain-specific foundation model for improving low-quality clinical images and strengthening downstream medical artificial intelligence workflows while preserving clinically relevant information. Cao et al. present AMIFound, a foundation model that unifies medical image restoration across seven imaging modalities, delivering robust enhancement across diverse degradations and preserving clinically relevant information for diagnosis.
期刊介绍:
Nature Machine Intelligence is a distinguished publication that presents original research and reviews on various topics in machine learning, robotics, and AI. Our focus extends beyond these fields, exploring their profound impact on other scientific disciplines, as well as societal and industrial aspects. We recognize limitless possibilities wherein machine intelligence can augment human capabilities and knowledge in domains like scientific exploration, healthcare, medical diagnostics, and the creation of safe and sustainable cities, transportation, and agriculture. Simultaneously, we acknowledge the emergence of ethical, social, and legal concerns due to the rapid pace of advancements.
To foster interdisciplinary discussions on these far-reaching implications, Nature Machine Intelligence serves as a platform for dialogue facilitated through Comments, News Features, News & Views articles, and Correspondence. Our goal is to encourage a comprehensive examination of these subjects.
Similar to all Nature-branded journals, Nature Machine Intelligence operates under the guidance of a team of skilled editors. We adhere to a fair and rigorous peer-review process, ensuring high standards of copy-editing and production, swift publication, and editorial independence.