{"title":"Endoir: A GAN-based method for fiber bundle endoscope image restoration","authors":"","doi":"10.1016/j.optlaseng.2024.108588","DOIUrl":null,"url":null,"abstract":"<div><p>Endoscope plays a crucial role in advancing minimally invasive surgeries. Ultra-compact, agile fiber endoscopes have gained significant popularity as an alternative to traditional bulk imaging systems. They have multiple advantages, such as large field of view, long depth of field and short rigid tip length. However, these systems exhibit honeycomb-like fixed patterns (HFP) and color bias in the output images, which can be attributed to the spacing and cladding around each fiber as well as the physical structure and low light conditions. To address these issues, we propose a fiber endoscope image restoration method based on generative adversarial network (GAN) named Endoir. The generator of Endoir employs a U-Net architecture that incorporates multi-scale skip connections between the encoder and decoder. It can incorporate low-level details with high-level semantics from feature maps in different scales and reduce the number of network parameters to improve the computation efficiency. We generate a synthetic dataset by simulating the fiber endoscope image scheme using an ordinary image dataset as a basis. This approach allows us to obtain a sufficient number of image pairs with more realistic usage scenarios. Our solution not only outperforms previous methods in terms of effectively removing the HFP but also provides the capability to correct color bias. The experiment results show that our method achieves superior accuracy in removing HFP and correcting color bias compared to existing approaches.</p></div>","PeriodicalId":49719,"journal":{"name":"Optics and Lasers in Engineering","volume":null,"pages":null},"PeriodicalIF":3.5000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Lasers in Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0143816624005669","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0
Abstract
Endoscope plays a crucial role in advancing minimally invasive surgeries. Ultra-compact, agile fiber endoscopes have gained significant popularity as an alternative to traditional bulk imaging systems. They have multiple advantages, such as large field of view, long depth of field and short rigid tip length. However, these systems exhibit honeycomb-like fixed patterns (HFP) and color bias in the output images, which can be attributed to the spacing and cladding around each fiber as well as the physical structure and low light conditions. To address these issues, we propose a fiber endoscope image restoration method based on generative adversarial network (GAN) named Endoir. The generator of Endoir employs a U-Net architecture that incorporates multi-scale skip connections between the encoder and decoder. It can incorporate low-level details with high-level semantics from feature maps in different scales and reduce the number of network parameters to improve the computation efficiency. We generate a synthetic dataset by simulating the fiber endoscope image scheme using an ordinary image dataset as a basis. This approach allows us to obtain a sufficient number of image pairs with more realistic usage scenarios. Our solution not only outperforms previous methods in terms of effectively removing the HFP but also provides the capability to correct color bias. The experiment results show that our method achieves superior accuracy in removing HFP and correcting color bias compared to existing approaches.
期刊介绍:
Optics and Lasers in Engineering aims at providing an international forum for the interchange of information on the development of optical techniques and laser technology in engineering. Emphasis is placed on contributions targeted at the practical use of methods and devices, the development and enhancement of solutions and new theoretical concepts for experimental methods.
Optics and Lasers in Engineering reflects the main areas in which optical methods are being used and developed for an engineering environment. Manuscripts should offer clear evidence of novelty and significance. Papers focusing on parameter optimization or computational issues are not suitable. Similarly, papers focussed on an application rather than the optical method fall outside the journal''s scope. The scope of the journal is defined to include the following:
-Optical Metrology-
Optical Methods for 3D visualization and virtual engineering-
Optical Techniques for Microsystems-
Imaging, Microscopy and Adaptive Optics-
Computational Imaging-
Laser methods in manufacturing-
Integrated optical and photonic sensors-
Optics and Photonics in Life Science-
Hyperspectral and spectroscopic methods-
Infrared and Terahertz techniques