{"title":"Zero-UMSIE:基于同构特征的零镜头水下多尺度图像增强方法。","authors":"Tong Liu, Kaiyan Zhu, Weiye Cao, Bolin Shan, Fangyi Guo","doi":"10.1364/OE.538120","DOIUrl":null,"url":null,"abstract":"<p><p>Due to the scattering and absorption of light, underwater images often exhibit degradation. Given the scarcity of paired real-world data and the inability of synthetic paired data to perfectly approximate real-world data, it's a challenge to restore these degraded images using deep neural networks. In this paper, a zero-shot underwater multi-scale image enhancement method (Zero-UMSIE) is proposed, which utilizes the isomorphism between the original underwater image and the re-degraded image. Specifically, Zero-UMSIE first estimates three latent components of the original underwater image: the global background light, the transmission map, and the scene radiance. Then, the estimated scene radiance is randomly mixed with the original underwater image to generate re-degraded images. Finally, a multi-scale loss and a set of tailored non-reference loss functions are employed to fine-tune the underwater image and enhance the generalization ability of the network. These functions implicitly control the learning preferences of the network and effectively address issues such as color bias and uneven illumination in underwater images, without the need for additional datasets. The proposed method is evaluated on three widely used real-world underwater image datasets. Extensive experiments on various benchmarks demonstrate that the proposed method is superior to state-of-the-art methods subjectively and objectively, which is competitive and applicable to diverse underwater conditions.</p>","PeriodicalId":19691,"journal":{"name":"Optics express","volume":"32 23","pages":"40398-40415"},"PeriodicalIF":3.2000,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Zero-UMSIE: a zero-shot underwater multi-scale image enhancement method based on isomorphic features.\",\"authors\":\"Tong Liu, Kaiyan Zhu, Weiye Cao, Bolin Shan, Fangyi Guo\",\"doi\":\"10.1364/OE.538120\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Due to the scattering and absorption of light, underwater images often exhibit degradation. Given the scarcity of paired real-world data and the inability of synthetic paired data to perfectly approximate real-world data, it's a challenge to restore these degraded images using deep neural networks. In this paper, a zero-shot underwater multi-scale image enhancement method (Zero-UMSIE) is proposed, which utilizes the isomorphism between the original underwater image and the re-degraded image. Specifically, Zero-UMSIE first estimates three latent components of the original underwater image: the global background light, the transmission map, and the scene radiance. Then, the estimated scene radiance is randomly mixed with the original underwater image to generate re-degraded images. Finally, a multi-scale loss and a set of tailored non-reference loss functions are employed to fine-tune the underwater image and enhance the generalization ability of the network. These functions implicitly control the learning preferences of the network and effectively address issues such as color bias and uneven illumination in underwater images, without the need for additional datasets. The proposed method is evaluated on three widely used real-world underwater image datasets. Extensive experiments on various benchmarks demonstrate that the proposed method is superior to state-of-the-art methods subjectively and objectively, which is competitive and applicable to diverse underwater conditions.</p>\",\"PeriodicalId\":19691,\"journal\":{\"name\":\"Optics express\",\"volume\":\"32 23\",\"pages\":\"40398-40415\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-11-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics express\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://doi.org/10.1364/OE.538120\",\"RegionNum\":2,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics express","FirstCategoryId":"101","ListUrlMain":"https://doi.org/10.1364/OE.538120","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
Zero-UMSIE: a zero-shot underwater multi-scale image enhancement method based on isomorphic features.
Due to the scattering and absorption of light, underwater images often exhibit degradation. Given the scarcity of paired real-world data and the inability of synthetic paired data to perfectly approximate real-world data, it's a challenge to restore these degraded images using deep neural networks. In this paper, a zero-shot underwater multi-scale image enhancement method (Zero-UMSIE) is proposed, which utilizes the isomorphism between the original underwater image and the re-degraded image. Specifically, Zero-UMSIE first estimates three latent components of the original underwater image: the global background light, the transmission map, and the scene radiance. Then, the estimated scene radiance is randomly mixed with the original underwater image to generate re-degraded images. Finally, a multi-scale loss and a set of tailored non-reference loss functions are employed to fine-tune the underwater image and enhance the generalization ability of the network. These functions implicitly control the learning preferences of the network and effectively address issues such as color bias and uneven illumination in underwater images, without the need for additional datasets. The proposed method is evaluated on three widely used real-world underwater image datasets. Extensive experiments on various benchmarks demonstrate that the proposed method is superior to state-of-the-art methods subjectively and objectively, which is competitive and applicable to diverse underwater conditions.
期刊介绍:
Optics Express is the all-electronic, open access journal for optics providing rapid publication for peer-reviewed articles that emphasize scientific and technology innovations in all aspects of optics and photonics.