解开图像在浑浊介质中传输的非定位性。

IF 3.2 2区 物理与天体物理 Q2 OPTICS
Optics express Pub Date : 2024-07-15 DOI:10.1364/OE.521581
Mohammadrahim Kazemzadeh, Liam Collard, Filippo Pisano, Linda Piscopo, Cristian Ciraci, Massimo De Vittorio, Ferruccio Pisanello
{"title":"解开图像在浑浊介质中传输的非定位性。","authors":"Mohammadrahim Kazemzadeh, Liam Collard, Filippo Pisano, Linda Piscopo, Cristian Ciraci, Massimo De Vittorio, Ferruccio Pisanello","doi":"10.1364/OE.521581","DOIUrl":null,"url":null,"abstract":"<p><p>Achieving high-fidelity image transmission through turbid media is a significant challenge facing both the AI and photonic/optical communities. While this capability holds promise for a variety of applications, including data transfer, neural endoscopy, and multi-mode optical fiber-based imaging, conventional deep learning methods struggle to capture the nuances of light propagation, leading to weak generalization and limited reconstruction performance. To address this limitation, we investigated the non-locality present in the reconstructed images and discovered that conventional deep learning methods rely on specific features extracted from the training dataset rather than meticulously reconstructing each pixel. This suggests that they fail to effectively capture long-range dependencies between pixels, which are crucial for accurate image reconstruction. Inspired by the physics of light propagation in turbid media, we developed a global attention mechanism to approach this problem from a broader perspective. Our network harnesses information redundancy generated by peculiar non-local features across the input and output fiber facets. This mechanism enables a two-order-of-magnitude performance boost and high fidelity to the data context, ensuring an accurate representation of intricate details in a pixel-to-pixel reconstruction rather than mere loss minimization.</p>","PeriodicalId":19691,"journal":{"name":"Optics express","volume":"32 15","pages":"26414-26433"},"PeriodicalIF":3.2000,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Unwrapping non-locality in the image transmission through turbid media.\",\"authors\":\"Mohammadrahim Kazemzadeh, Liam Collard, Filippo Pisano, Linda Piscopo, Cristian Ciraci, Massimo De Vittorio, Ferruccio Pisanello\",\"doi\":\"10.1364/OE.521581\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Achieving high-fidelity image transmission through turbid media is a significant challenge facing both the AI and photonic/optical communities. While this capability holds promise for a variety of applications, including data transfer, neural endoscopy, and multi-mode optical fiber-based imaging, conventional deep learning methods struggle to capture the nuances of light propagation, leading to weak generalization and limited reconstruction performance. To address this limitation, we investigated the non-locality present in the reconstructed images and discovered that conventional deep learning methods rely on specific features extracted from the training dataset rather than meticulously reconstructing each pixel. This suggests that they fail to effectively capture long-range dependencies between pixels, which are crucial for accurate image reconstruction. Inspired by the physics of light propagation in turbid media, we developed a global attention mechanism to approach this problem from a broader perspective. Our network harnesses information redundancy generated by peculiar non-local features across the input and output fiber facets. This mechanism enables a two-order-of-magnitude performance boost and high fidelity to the data context, ensuring an accurate representation of intricate details in a pixel-to-pixel reconstruction rather than mere loss minimization.</p>\",\"PeriodicalId\":19691,\"journal\":{\"name\":\"Optics express\",\"volume\":\"32 15\",\"pages\":\"26414-26433\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-07-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics express\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://doi.org/10.1364/OE.521581\",\"RegionNum\":2,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics express","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1364/OE.521581","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

摘要

在浑浊介质中实现高保真图像传输是人工智能和光子/光学领域面临的一项重大挑战。虽然这种能力有望用于数据传输、神经内窥镜和基于多模光纤的成像等多种应用,但传统的深度学习方法难以捕捉光传播的细微差别,导致泛化能力较弱,重建性能有限。为了解决这一局限性,我们研究了重建图像中存在的非位置性,发现传统的深度学习方法依赖于从训练数据集中提取的特定特征,而不是细致地重建每个像素。这表明,这些方法无法有效捕捉像素之间的长距离依赖关系,而这对于准确重建图像至关重要。受光在浑浊介质中传播的物理学原理启发,我们开发了一种全局注意力机制,从更广阔的视角来解决这一问题。我们的网络利用了输入和输出光纤面上特殊的非局部特征所产生的信息冗余。这种机制使性能提升了两个数量级,并高度忠实于数据背景,确保在像素到像素的重建中准确呈现复杂的细节,而不仅仅是损耗最小化。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Unwrapping non-locality in the image transmission through turbid media.

Achieving high-fidelity image transmission through turbid media is a significant challenge facing both the AI and photonic/optical communities. While this capability holds promise for a variety of applications, including data transfer, neural endoscopy, and multi-mode optical fiber-based imaging, conventional deep learning methods struggle to capture the nuances of light propagation, leading to weak generalization and limited reconstruction performance. To address this limitation, we investigated the non-locality present in the reconstructed images and discovered that conventional deep learning methods rely on specific features extracted from the training dataset rather than meticulously reconstructing each pixel. This suggests that they fail to effectively capture long-range dependencies between pixels, which are crucial for accurate image reconstruction. Inspired by the physics of light propagation in turbid media, we developed a global attention mechanism to approach this problem from a broader perspective. Our network harnesses information redundancy generated by peculiar non-local features across the input and output fiber facets. This mechanism enables a two-order-of-magnitude performance boost and high fidelity to the data context, ensuring an accurate representation of intricate details in a pixel-to-pixel reconstruction rather than mere loss minimization.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Optics express
Optics express 物理-光学
CiteScore
6.60
自引率
15.80%
发文量
5182
审稿时长
2.1 months
期刊介绍: Optics Express is the all-electronic, open access journal for optics providing rapid publication for peer-reviewed articles that emphasize scientific and technology innovations in all aspects of optics and photonics.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信