Learning From the Abyss: Self-Adaptive Distillation for Enhancing Underwater Images With Complex Degradations

IF 9.9 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
IEEE Transactions on Multimedia Pub Date : 2026-01-01 Epub Date: 2026-04-30 DOI:10.1109/TMM.2026.3689437
Yu Zhao;Xiaofeng Cong;Chuanrui Hu;Lu Dong;Jie Gui;James Tin-Yau Kwok;Yuyan Yan Tang
{"title":"Learning From the Abyss: Self-Adaptive Distillation for Enhancing Underwater Images With Complex Degradations","authors":"Yu Zhao;Xiaofeng Cong;Chuanrui Hu;Lu Dong;Jie Gui;James Tin-Yau Kwok;Yuyan Yan Tang","doi":"10.1109/TMM.2026.3689437","DOIUrl":null,"url":null,"abstract":"While deep learning has advanced underwater image enhancement (UIE), progress is fundamentally hampered by the scarcity of paired training data. Semi-supervised methods, which leverage abundant unlabeled images, offer a promising solution but often employ naive, static weighting for pseudo-labels. This overlooks a key principle: the most informative training samples are those that represent a successful restoration from severe degradation, thus possessing a greater transformation difficulty. To address this, we propose a novel adaptive training paradigm, the Self-Distilled Degradation-Aware Network (SDDA-Net), governed by an incentive-driven weighting mechanism. We introduce a scoring function that evaluates each pseudo-label by considering both its perceptual quality and a term that is inversely proportional to its structural similarity to the input. This score, which quantifies the difficulty and success of the enhancement, is then used to dynamically modulate the sample’s influence on the unsupervised loss. By allocating greater learning weights to successfully restored, complex examples, our framework forces the model to focus on mastering challenging degradations. Extensive experiments on multiple benchmark datasets demonstrate that this adaptive approach significantly outperforms current state-of-the-art methods, validating that the strategic, sample-adaptive modulation of the learning process is critical for success in data-scarce restoration tasks.","PeriodicalId":13273,"journal":{"name":"IEEE Transactions on Multimedia","volume":"28 ","pages":"9269-9280"},"PeriodicalIF":9.9000,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Multimedia","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11501802/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/4/30 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

While deep learning has advanced underwater image enhancement (UIE), progress is fundamentally hampered by the scarcity of paired training data. Semi-supervised methods, which leverage abundant unlabeled images, offer a promising solution but often employ naive, static weighting for pseudo-labels. This overlooks a key principle: the most informative training samples are those that represent a successful restoration from severe degradation, thus possessing a greater transformation difficulty. To address this, we propose a novel adaptive training paradigm, the Self-Distilled Degradation-Aware Network (SDDA-Net), governed by an incentive-driven weighting mechanism. We introduce a scoring function that evaluates each pseudo-label by considering both its perceptual quality and a term that is inversely proportional to its structural similarity to the input. This score, which quantifies the difficulty and success of the enhancement, is then used to dynamically modulate the sample’s influence on the unsupervised loss. By allocating greater learning weights to successfully restored, complex examples, our framework forces the model to focus on mastering challenging degradations. Extensive experiments on multiple benchmark datasets demonstrate that this adaptive approach significantly outperforms current state-of-the-art methods, validating that the strategic, sample-adaptive modulation of the learning process is critical for success in data-scarce restoration tasks.
从深渊学习:自适应蒸馏增强水下图像与复杂的退化
虽然深度学习在水下图像增强(UIE)方面取得了进步,但从根本上说,配对训练数据的缺乏阻碍了这一进展。利用大量未标记图像的半监督方法提供了一个很有前途的解决方案,但通常对伪标签采用幼稚的静态加权。这忽略了一个关键原则:信息量最大的训练样本是那些代表从严重退化中成功恢复的样本,因此具有更大的转换困难。为了解决这个问题,我们提出了一种新的自适应训练范式,即由激励驱动的加权机制控制的自蒸馏退化感知网络(SDDA-Net)。我们引入了一个评分函数,通过考虑每个伪标签的感知质量和与输入结构相似度成反比的术语来评估每个伪标签。这个分数量化了增强的难度和成功程度,然后用于动态调节样本对无监督损失的影响。通过为成功恢复的复杂示例分配更大的学习权重,我们的框架迫使模型专注于掌握具有挑战性的退化。在多个基准数据集上进行的大量实验表明,这种自适应方法显著优于当前最先进的方法,验证了学习过程的战略性、样本自适应调制对于数据稀缺恢复任务的成功至关重要。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Multimedia
IEEE Transactions on Multimedia 工程技术-电信学
CiteScore
11.70
自引率
11.00%
发文量
576
审稿时长
5.5 months
期刊介绍: The IEEE Transactions on Multimedia delves into diverse aspects of multimedia technology and applications, covering circuits, networking, signal processing, systems, software, and systems integration. The scope aligns with the Fields of Interest of the sponsors, ensuring a comprehensive exploration of research in multimedia.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书