无线图像传输的深度联合源信道编码:一模对多

IF 5.5 3区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Feng Wang;Xuechen Chen;Xiaoheng Deng;Siyu Lin
{"title":"无线图像传输的深度联合源信道编码:一模对多","authors":"Feng Wang;Xuechen Chen;Xiaoheng Deng;Siyu Lin","doi":"10.1109/LWC.2025.3547527","DOIUrl":null,"url":null,"abstract":"In recent years, researches on deep joint source-channel coding (DeepJSCC) for wireless communications achieve great success owing to the employment of deep learning (DL). However, all existing DeepJSCC schemes only work with a single bandwidth, ignoring the fact that different users have different bandwidths. Under additive Gaussian white noise (AWGN) channel, we present a DeepJSCC scheme utilizing auto-regressive model and transformer block for wireless image transmission, where a single model is trained across multiple compression ratios (CRs) through masking, enabling it to adapt to various bandwidth CRs. Specifically, at the transmitter, our encoder first combines convolutional kernels with transformer block to effectively capture both global and local features of an image. Then we transmit a portion of the encoded image by masking. At the receiver, based on the masking strategy, we use auto-regressive model that fully utilizes the known prior information to restore the masked portions of the encoded image. Extensive experiments show that our scheme achieves the adaptation of a single model to various CRs and better image reconstruction quality than the separately models trained under fixed CRs.","PeriodicalId":13343,"journal":{"name":"IEEE Wireless Communications Letters","volume":"14 5","pages":"1501-1505"},"PeriodicalIF":5.5000,"publicationDate":"2025-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Joint Source-Channel Coding for Wireless Image Transmission: One-Model-to-Many\",\"authors\":\"Feng Wang;Xuechen Chen;Xiaoheng Deng;Siyu Lin\",\"doi\":\"10.1109/LWC.2025.3547527\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, researches on deep joint source-channel coding (DeepJSCC) for wireless communications achieve great success owing to the employment of deep learning (DL). However, all existing DeepJSCC schemes only work with a single bandwidth, ignoring the fact that different users have different bandwidths. Under additive Gaussian white noise (AWGN) channel, we present a DeepJSCC scheme utilizing auto-regressive model and transformer block for wireless image transmission, where a single model is trained across multiple compression ratios (CRs) through masking, enabling it to adapt to various bandwidth CRs. Specifically, at the transmitter, our encoder first combines convolutional kernels with transformer block to effectively capture both global and local features of an image. Then we transmit a portion of the encoded image by masking. At the receiver, based on the masking strategy, we use auto-regressive model that fully utilizes the known prior information to restore the masked portions of the encoded image. Extensive experiments show that our scheme achieves the adaptation of a single model to various CRs and better image reconstruction quality than the separately models trained under fixed CRs.\",\"PeriodicalId\":13343,\"journal\":{\"name\":\"IEEE Wireless Communications Letters\",\"volume\":\"14 5\",\"pages\":\"1501-1505\"},\"PeriodicalIF\":5.5000,\"publicationDate\":\"2025-03-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Wireless Communications Letters\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10909228/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Wireless Communications Letters","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10909228/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

近年来,由于采用了深度学习技术,无线通信中的深度联合源信道编码(DeepJSCC)研究取得了巨大成功。然而,所有现有的DeepJSCC方案只能在单一带宽下工作,忽略了不同用户具有不同带宽的事实。在加性高斯白噪声(AWGN)信道下,我们提出了一种利用自回归模型和变压器块的深度jscc方案,用于无线图像传输,其中单个模型通过掩蔽在多个压缩比(cr)上进行训练,使其能够适应各种带宽cr。具体来说,在发送端,我们的编码器首先将卷积核与变压器块结合起来,有效地捕获图像的全局和局部特征。然后我们通过掩码传输编码图像的一部分。在接收端,基于掩蔽策略,我们使用充分利用已知先验信息的自回归模型来恢复编码图像的掩蔽部分。大量的实验表明,我们的方案实现了单一模型对各种cr的自适应,并且比在固定cr下单独训练的模型具有更好的图像重建质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep Joint Source-Channel Coding for Wireless Image Transmission: One-Model-to-Many
In recent years, researches on deep joint source-channel coding (DeepJSCC) for wireless communications achieve great success owing to the employment of deep learning (DL). However, all existing DeepJSCC schemes only work with a single bandwidth, ignoring the fact that different users have different bandwidths. Under additive Gaussian white noise (AWGN) channel, we present a DeepJSCC scheme utilizing auto-regressive model and transformer block for wireless image transmission, where a single model is trained across multiple compression ratios (CRs) through masking, enabling it to adapt to various bandwidth CRs. Specifically, at the transmitter, our encoder first combines convolutional kernels with transformer block to effectively capture both global and local features of an image. Then we transmit a portion of the encoded image by masking. At the receiver, based on the masking strategy, we use auto-regressive model that fully utilizes the known prior information to restore the masked portions of the encoded image. Extensive experiments show that our scheme achieves the adaptation of a single model to various CRs and better image reconstruction quality than the separately models trained under fixed CRs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Wireless Communications Letters
IEEE Wireless Communications Letters Engineering-Electrical and Electronic Engineering
CiteScore
12.30
自引率
6.30%
发文量
481
期刊介绍: IEEE Wireless Communications Letters publishes short papers in a rapid publication cycle on advances in the state-of-the-art of wireless communications. Both theoretical contributions (including new techniques, concepts, and analyses) and practical contributions (including system experiments and prototypes, and new applications) are encouraged. This journal focuses on the physical layer and the link layer of wireless communication systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信