可变速率极端图像压缩的联合退化感知任意尺度超分辨率

IF 5.9 1区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
IEEE Transactions on Broadcasting Pub Date : 2026-09-01 Epub Date: 2026-04-06 DOI:10.1109/TBC.2026.3680050
Xinning Chai;Zhengxue Cheng;Xin Li;Rong Xie;Li Song
{"title":"可变速率极端图像压缩的联合退化感知任意尺度超分辨率","authors":"Xinning Chai;Zhengxue Cheng;Xin Li;Rong Xie;Li Song","doi":"10.1109/TBC.2026.3680050","DOIUrl":null,"url":null,"abstract":"Recent diffusion-based extreme image compression methods have demonstrated remarkable performance at ultra-low bitrates (0.1 <0.1 bpp). However, most approaches require training separate diffusion models for each target bitrate, resulting in substantial computational overhead and hindering practical deployment. Meanwhile, recent studies have shown that joint super-resolution can serve as an effective approach for enhancing low-bitrate reconstruction. However, when moving toward ultra-low-bitrate regimes, these methods struggle due to severe information loss, and their reliance on fixed super-resolution scales prevents flexible adaptation across diverse bitrates. To address these limitations, we propose ASSR-EIC, a novel image compression framework that leverages arbitrary-scale super-resolution (ASSR) to support variable-rate extreme image compression (EIC). An arbitrary-scale downsampling module is introduced at the encoder side to provide controllable rate reduction, while a diffusion-based, joint degradation-aware ASSR decoder enables rate-adaptive reconstruction within a single model. We exploit the compression- and rescaling-aware diffusion prior to guide the reconstruction, yielding high-fidelity and high-realism restoration across diverse compression and rescaling settings. Specifically, we design a global compression–rescaling adaptor that offers holistic guidance for rate adaptation, and a local compression–rescaling modulator that dynamically balances generative and fidelity-oriented behaviors to achieve fine-grained, bitrate-adaptive detail restoration. To further enhance reconstruction quality, we introduce a dual semantic-enhanced design. Extensive experiments demonstrate that ASSR-EIC delivers state-of-the-art performance in extreme image compression while simultaneously supporting flexible bitrate control and adaptive rate-dependent reconstruction.","PeriodicalId":13159,"journal":{"name":"IEEE Transactions on Broadcasting","volume":"72 3","pages":"904-919"},"PeriodicalIF":5.9000,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Joint Degradation-Aware Arbitrary-Scale Super-Resolution for Variable-Rate Extreme Image Compression\",\"authors\":\"Xinning Chai;Zhengxue Cheng;Xin Li;Rong Xie;Li Song\",\"doi\":\"10.1109/TBC.2026.3680050\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recent diffusion-based extreme image compression methods have demonstrated remarkable performance at ultra-low bitrates (0.1 <0.1 bpp). However, most approaches require training separate diffusion models for each target bitrate, resulting in substantial computational overhead and hindering practical deployment. Meanwhile, recent studies have shown that joint super-resolution can serve as an effective approach for enhancing low-bitrate reconstruction. However, when moving toward ultra-low-bitrate regimes, these methods struggle due to severe information loss, and their reliance on fixed super-resolution scales prevents flexible adaptation across diverse bitrates. To address these limitations, we propose ASSR-EIC, a novel image compression framework that leverages arbitrary-scale super-resolution (ASSR) to support variable-rate extreme image compression (EIC). An arbitrary-scale downsampling module is introduced at the encoder side to provide controllable rate reduction, while a diffusion-based, joint degradation-aware ASSR decoder enables rate-adaptive reconstruction within a single model. We exploit the compression- and rescaling-aware diffusion prior to guide the reconstruction, yielding high-fidelity and high-realism restoration across diverse compression and rescaling settings. Specifically, we design a global compression–rescaling adaptor that offers holistic guidance for rate adaptation, and a local compression–rescaling modulator that dynamically balances generative and fidelity-oriented behaviors to achieve fine-grained, bitrate-adaptive detail restoration. To further enhance reconstruction quality, we introduce a dual semantic-enhanced design. Extensive experiments demonstrate that ASSR-EIC delivers state-of-the-art performance in extreme image compression while simultaneously supporting flexible bitrate control and adaptive rate-dependent reconstruction.\",\"PeriodicalId\":13159,\"journal\":{\"name\":\"IEEE Transactions on Broadcasting\",\"volume\":\"72 3\",\"pages\":\"904-919\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2026-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Broadcasting\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11475314/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/4/6 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Broadcasting","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11475314/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/4/6 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

最近基于扩散的极端图像压缩方法在超低比特率(0.1 <0.1 bpp)下表现出了显著的性能。然而,大多数方法需要为每个目标比特率训练单独的扩散模型,这导致了大量的计算开销并阻碍了实际部署。同时,最近的研究表明,联合超分辨率可以作为增强低比特率重建的有效方法。然而,当转向超低比特率时,这些方法由于严重的信息丢失而挣扎,并且它们对固定超分辨率尺度的依赖阻碍了灵活地适应不同的比特率。为了解决这些限制,我们提出了一种新的图像压缩框架ASSR-EIC,它利用任意尺度超分辨率(ASSR)来支持可变速率极限图像压缩(EIC)。在编码器侧引入了任意尺度下采样模块,以提供可控的速率降低,而基于扩散的联合退化感知ASSR解码器可在单个模型内实现速率自适应重建。我们利用压缩和重缩放感知扩散来指导重建,在不同的压缩和重缩放设置下产生高保真度和高真实感的恢复。具体来说,我们设计了一个全局压缩缩放适配器,为速率适应提供整体指导,以及一个局部压缩缩放调制器,动态平衡生成和面向保真度的行为,以实现细粒度、比特率自适应的细节恢复。为了进一步提高重建质量,我们引入了双语义增强设计。广泛的实验表明,ASSR-EIC在极端图像压缩中提供了最先进的性能,同时支持灵活的比特率控制和自适应速率相关重建。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Joint Degradation-Aware Arbitrary-Scale Super-Resolution for Variable-Rate Extreme Image Compression
Recent diffusion-based extreme image compression methods have demonstrated remarkable performance at ultra-low bitrates (0.1 <0.1 bpp). However, most approaches require training separate diffusion models for each target bitrate, resulting in substantial computational overhead and hindering practical deployment. Meanwhile, recent studies have shown that joint super-resolution can serve as an effective approach for enhancing low-bitrate reconstruction. However, when moving toward ultra-low-bitrate regimes, these methods struggle due to severe information loss, and their reliance on fixed super-resolution scales prevents flexible adaptation across diverse bitrates. To address these limitations, we propose ASSR-EIC, a novel image compression framework that leverages arbitrary-scale super-resolution (ASSR) to support variable-rate extreme image compression (EIC). An arbitrary-scale downsampling module is introduced at the encoder side to provide controllable rate reduction, while a diffusion-based, joint degradation-aware ASSR decoder enables rate-adaptive reconstruction within a single model. We exploit the compression- and rescaling-aware diffusion prior to guide the reconstruction, yielding high-fidelity and high-realism restoration across diverse compression and rescaling settings. Specifically, we design a global compression–rescaling adaptor that offers holistic guidance for rate adaptation, and a local compression–rescaling modulator that dynamically balances generative and fidelity-oriented behaviors to achieve fine-grained, bitrate-adaptive detail restoration. To further enhance reconstruction quality, we introduce a dual semantic-enhanced design. Extensive experiments demonstrate that ASSR-EIC delivers state-of-the-art performance in extreme image compression while simultaneously supporting flexible bitrate control and adaptive rate-dependent reconstruction.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Broadcasting
IEEE Transactions on Broadcasting 工程技术-电信学
CiteScore
9.40
自引率
31.10%
发文量
79
审稿时长
6-12 weeks
期刊介绍: The Society’s Field of Interest is “Devices, equipment, techniques and systems related to broadcast technology, including the production, distribution, transmission, and propagation aspects.” In addition to this formal FOI statement, which is used to provide guidance to the Publications Committee in the selection of content, the AdCom has further resolved that “broadcast systems includes all aspects of transmission, propagation, and reception.”
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书