Jing Ma , Yiwei Shi , Shibai Yin , Yibin Wang , Yanfang Fu , Yee-Hong Yang
{"title":"基于双先验细化的双分支小波扩散模型用于水下图像增强","authors":"Jing Ma , Yiwei Shi , Shibai Yin , Yibin Wang , Yanfang Fu , Yee-Hong Yang","doi":"10.1016/j.jvcir.2025.104535","DOIUrl":null,"url":null,"abstract":"<div><div>Underwater images often suffer from color distortion and detail loss due to the scattering and absorption of light, presenting significant challenges in Underwater Image Enhancement (UIE). Although wavelet-based learning methods address this problem by correcting colors in low-frequency components and enhancing details in high-frequency components, they still struggle to achieve visual fidelity for human perception. As a perceptually driven approach, conditional Denoising Diffusion Models (CDDMs) combined with wavelet transforms have been widely adopted for UIE. However, these methods often focus on the generative capability of CDDM in the low-frequency components, while neglecting the effectiveness of CDDM in high-frequency processing as well as the role of accurate priors in guiding the diffusion process. To address these limitations, we propose Dual-Branch Wavelet Diffusion models with Dual-Prior Refinement (DwaveDiff) for UIE. By decomposing the image into low-frequency and high-frequency subbands using the Haar wavelet transform, the reduced-dimensional frequency information not only accelerates CDDM inference but also provides distinct subbands, allowing CDDM to effectively handle color correction and detail recovery separately. Specifically, we use the Red Channel Prior image as a condition for the low-frequency branch of the CDDM to correct color, and the Edge Captured Map as a condition for the high-frequency branch of the CDDM to recover details. In addtion, the prior refinement strategy in the CDDM ensures that accurate prior information is used, guiding DwaveDiff to perform effective enhancement. Experimental results on both synthetic and real-world image datasets demonstrate that our method outperforms existing approaches both quantitatively and qualitatively.</div></div>","PeriodicalId":54755,"journal":{"name":"Journal of Visual Communication and Image Representation","volume":"111 ","pages":"Article 104535"},"PeriodicalIF":3.1000,"publicationDate":"2025-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Dual-Branch Wavelet Diffusion models with Dual-Prior Refinement for Underwater Image Enhancement\",\"authors\":\"Jing Ma , Yiwei Shi , Shibai Yin , Yibin Wang , Yanfang Fu , Yee-Hong Yang\",\"doi\":\"10.1016/j.jvcir.2025.104535\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Underwater images often suffer from color distortion and detail loss due to the scattering and absorption of light, presenting significant challenges in Underwater Image Enhancement (UIE). Although wavelet-based learning methods address this problem by correcting colors in low-frequency components and enhancing details in high-frequency components, they still struggle to achieve visual fidelity for human perception. As a perceptually driven approach, conditional Denoising Diffusion Models (CDDMs) combined with wavelet transforms have been widely adopted for UIE. However, these methods often focus on the generative capability of CDDM in the low-frequency components, while neglecting the effectiveness of CDDM in high-frequency processing as well as the role of accurate priors in guiding the diffusion process. To address these limitations, we propose Dual-Branch Wavelet Diffusion models with Dual-Prior Refinement (DwaveDiff) for UIE. By decomposing the image into low-frequency and high-frequency subbands using the Haar wavelet transform, the reduced-dimensional frequency information not only accelerates CDDM inference but also provides distinct subbands, allowing CDDM to effectively handle color correction and detail recovery separately. Specifically, we use the Red Channel Prior image as a condition for the low-frequency branch of the CDDM to correct color, and the Edge Captured Map as a condition for the high-frequency branch of the CDDM to recover details. In addtion, the prior refinement strategy in the CDDM ensures that accurate prior information is used, guiding DwaveDiff to perform effective enhancement. Experimental results on both synthetic and real-world image datasets demonstrate that our method outperforms existing approaches both quantitatively and qualitatively.</div></div>\",\"PeriodicalId\":54755,\"journal\":{\"name\":\"Journal of Visual Communication and Image Representation\",\"volume\":\"111 \",\"pages\":\"Article 104535\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-07-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Visual Communication and Image Representation\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S104732032500149X\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Visual Communication and Image Representation","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S104732032500149X","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Dual-Branch Wavelet Diffusion models with Dual-Prior Refinement for Underwater Image Enhancement
Underwater images often suffer from color distortion and detail loss due to the scattering and absorption of light, presenting significant challenges in Underwater Image Enhancement (UIE). Although wavelet-based learning methods address this problem by correcting colors in low-frequency components and enhancing details in high-frequency components, they still struggle to achieve visual fidelity for human perception. As a perceptually driven approach, conditional Denoising Diffusion Models (CDDMs) combined with wavelet transforms have been widely adopted for UIE. However, these methods often focus on the generative capability of CDDM in the low-frequency components, while neglecting the effectiveness of CDDM in high-frequency processing as well as the role of accurate priors in guiding the diffusion process. To address these limitations, we propose Dual-Branch Wavelet Diffusion models with Dual-Prior Refinement (DwaveDiff) for UIE. By decomposing the image into low-frequency and high-frequency subbands using the Haar wavelet transform, the reduced-dimensional frequency information not only accelerates CDDM inference but also provides distinct subbands, allowing CDDM to effectively handle color correction and detail recovery separately. Specifically, we use the Red Channel Prior image as a condition for the low-frequency branch of the CDDM to correct color, and the Edge Captured Map as a condition for the high-frequency branch of the CDDM to recover details. In addtion, the prior refinement strategy in the CDDM ensures that accurate prior information is used, guiding DwaveDiff to perform effective enhancement. Experimental results on both synthetic and real-world image datasets demonstrate that our method outperforms existing approaches both quantitatively and qualitatively.
期刊介绍:
The Journal of Visual Communication and Image Representation publishes papers on state-of-the-art visual communication and image representation, with emphasis on novel technologies and theoretical work in this multidisciplinary area of pure and applied research. The field of visual communication and image representation is considered in its broadest sense and covers both digital and analog aspects as well as processing and communication in biological visual systems.