{"title":"基于变压器的神经网络在深部组织成像中的散射与图像恢复。","authors":"Xiangcong Xu,Renlong Zhang,Chenggui Luo,Chi Zhang,Yanping Li,Danying Lin,Bin Yu,Liwei Liu,Xiaoyu Weng,Yiping Wang,Lingjie Kong,Jia Li,Junle Qu","doi":"10.1073/pnas.2503576122","DOIUrl":null,"url":null,"abstract":"Imaging biological structures deep inside tissues is crucial but challenging due to common light scattering. This study proposes a multiattention network that directly maps degraded scattering two-photon excitation fluorescence (TPEF) images to high-quality scattering-free images, thereby computationally extending the imaging depth for TPEF without requiring complex optical additions. The model relies solely on simulated data rather than well-registered real data pairs, and is trained to descatter and restore hidden spatial information at greater depths. Quantitative evaluations on simulated fluorescent beads and vasculature show significant performance improvements in peak signal-to-noise ratio (23 to 29 dB) and structural similarity index (23×) compared to the raw data. We also apply the framework to various ex vivo and in vivo experiments, achieving clear visualization of lipid droplets up to a depth of 1,300 μm and of vascular structure and astrocytes up to 950 μm and 500 μm, respectively, in live mouse brains at lower excitation powers.","PeriodicalId":20548,"journal":{"name":"Proceedings of the National Academy of Sciences of the United States of America","volume":"129 1","pages":"e2503576122"},"PeriodicalIF":9.1000,"publicationDate":"2025-10-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Descattering and image restoration with a transformer-based neural network in deep tissue imaging.\",\"authors\":\"Xiangcong Xu,Renlong Zhang,Chenggui Luo,Chi Zhang,Yanping Li,Danying Lin,Bin Yu,Liwei Liu,Xiaoyu Weng,Yiping Wang,Lingjie Kong,Jia Li,Junle Qu\",\"doi\":\"10.1073/pnas.2503576122\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Imaging biological structures deep inside tissues is crucial but challenging due to common light scattering. This study proposes a multiattention network that directly maps degraded scattering two-photon excitation fluorescence (TPEF) images to high-quality scattering-free images, thereby computationally extending the imaging depth for TPEF without requiring complex optical additions. The model relies solely on simulated data rather than well-registered real data pairs, and is trained to descatter and restore hidden spatial information at greater depths. Quantitative evaluations on simulated fluorescent beads and vasculature show significant performance improvements in peak signal-to-noise ratio (23 to 29 dB) and structural similarity index (23×) compared to the raw data. We also apply the framework to various ex vivo and in vivo experiments, achieving clear visualization of lipid droplets up to a depth of 1,300 μm and of vascular structure and astrocytes up to 950 μm and 500 μm, respectively, in live mouse brains at lower excitation powers.\",\"PeriodicalId\":20548,\"journal\":{\"name\":\"Proceedings of the National Academy of Sciences of the United States of America\",\"volume\":\"129 1\",\"pages\":\"e2503576122\"},\"PeriodicalIF\":9.1000,\"publicationDate\":\"2025-10-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the National Academy of Sciences of the United States of America\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1073/pnas.2503576122\",\"RegionNum\":1,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the National Academy of Sciences of the United States of America","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1073/pnas.2503576122","RegionNum":1,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
Descattering and image restoration with a transformer-based neural network in deep tissue imaging.
Imaging biological structures deep inside tissues is crucial but challenging due to common light scattering. This study proposes a multiattention network that directly maps degraded scattering two-photon excitation fluorescence (TPEF) images to high-quality scattering-free images, thereby computationally extending the imaging depth for TPEF without requiring complex optical additions. The model relies solely on simulated data rather than well-registered real data pairs, and is trained to descatter and restore hidden spatial information at greater depths. Quantitative evaluations on simulated fluorescent beads and vasculature show significant performance improvements in peak signal-to-noise ratio (23 to 29 dB) and structural similarity index (23×) compared to the raw data. We also apply the framework to various ex vivo and in vivo experiments, achieving clear visualization of lipid droplets up to a depth of 1,300 μm and of vascular structure and astrocytes up to 950 μm and 500 μm, respectively, in live mouse brains at lower excitation powers.
期刊介绍:
The Proceedings of the National Academy of Sciences (PNAS), a peer-reviewed journal of the National Academy of Sciences (NAS), serves as an authoritative source for high-impact, original research across the biological, physical, and social sciences. With a global scope, the journal welcomes submissions from researchers worldwide, making it an inclusive platform for advancing scientific knowledge.