Joint Source-Channel Coding for a Multivariate Gaussian Over a Gaussian MAC Using Variational Domain Adaptation

IF 7.4 1区 计算机科学 Q1 TELECOMMUNICATIONS
Yishen Li;Xuechen Chen;Xiaoheng Deng
{"title":"Joint Source-Channel Coding for a Multivariate Gaussian Over a Gaussian MAC Using Variational Domain Adaptation","authors":"Yishen Li;Xuechen Chen;Xiaoheng Deng","doi":"10.1109/TCCN.2023.3294754","DOIUrl":null,"url":null,"abstract":"With the development of the distributed learning and edge computing, servers must often receive information from multiple terminal devices; thus, the importance of source-channel coding for distributed sources over multiple access channels (MACs) becomes more and more significant. This letter presents a deep joint source-channel coding (JSCC) design for a multivariate Gaussian source over a Gaussian MAC. The widely used autoencoder based deep-JSCC cannot perform stably under such conditions due to their easiness to fall into local optimum. Therefore we propose the variational domain adaptation (VDA)-JSCC scheme. Firstly, the loss function with an additional regularization term is introduced through variational analysis. The crucial prior distribution related to this item is obtained by domain adaptation, which is a transfer learning method. The proposed fine-tuning technique during the training process yields further performance improvement. Experiment results show that VDA-JSCC can always learn reasonable coding structures without artificial design and outperforms other state-of-the-art methods under different channel signal-to-noise ratios (CSNRs). We have also analyzed the reason why the performance of VDA-JSCC deteriorates in high CSNR range and then replace the encoder of VDA-JSCC with Mixture-of-Experts to improve its performance in high CSNR range. Finally, VDA-JSCC exhibits considerable robustness when the channel quality or correlation coefficient varies.","PeriodicalId":13069,"journal":{"name":"IEEE Transactions on Cognitive Communications and Networking","volume":"9 6","pages":"1424-1437"},"PeriodicalIF":7.4000,"publicationDate":"2023-07-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cognitive Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10180059/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

With the development of the distributed learning and edge computing, servers must often receive information from multiple terminal devices; thus, the importance of source-channel coding for distributed sources over multiple access channels (MACs) becomes more and more significant. This letter presents a deep joint source-channel coding (JSCC) design for a multivariate Gaussian source over a Gaussian MAC. The widely used autoencoder based deep-JSCC cannot perform stably under such conditions due to their easiness to fall into local optimum. Therefore we propose the variational domain adaptation (VDA)-JSCC scheme. Firstly, the loss function with an additional regularization term is introduced through variational analysis. The crucial prior distribution related to this item is obtained by domain adaptation, which is a transfer learning method. The proposed fine-tuning technique during the training process yields further performance improvement. Experiment results show that VDA-JSCC can always learn reasonable coding structures without artificial design and outperforms other state-of-the-art methods under different channel signal-to-noise ratios (CSNRs). We have also analyzed the reason why the performance of VDA-JSCC deteriorates in high CSNR range and then replace the encoder of VDA-JSCC with Mixture-of-Experts to improve its performance in high CSNR range. Finally, VDA-JSCC exhibits considerable robustness when the channel quality or correlation coefficient varies.
利用变域自适应为高斯 MAC 上的多变量高斯进行源-信道联合编码
随着分布式学习和边缘计算的发展,服务器必须经常接收来自多个终端设备的信息;因此,在多个接入信道(MAC)上对分布式源进行源信道编码变得越来越重要。本文提出了一种针对高斯 MAC 上的多变量高斯源的深度联合源信道编码(JSCC)设计。广泛使用的基于自动编码器的深度联合信源信道编码(JSCC)由于容易陷入局部最优而无法在这种条件下稳定运行。因此,我们提出了变域适应(VDA)-JSCC 方案。首先,通过变分分析引入带有附加正则项的损失函数。通过域自适应(一种迁移学习方法)获得与该项相关的关键先验分布。在训练过程中提出的微调技术进一步提高了性能。实验结果表明,VDA-JSCC 不需要人为设计就能学习到合理的编码结构,在不同信道信噪比(CSNR)下的表现优于其他先进方法。我们还分析了 VDA-JSCC 在高 CSNR 范围内性能下降的原因,然后用 Mixture-of-Experts 替换了 VDA-JSCC 的编码器,以提高其在高 CSNR 范围内的性能。最后,当信道质量或相关系数发生变化时,VDA-JSCC 表现出相当强的鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Cognitive Communications and Networking
IEEE Transactions on Cognitive Communications and Networking Computer Science-Artificial Intelligence
CiteScore
15.50
自引率
7.00%
发文量
108
期刊介绍: The IEEE Transactions on Cognitive Communications and Networking (TCCN) aims to publish high-quality manuscripts that push the boundaries of cognitive communications and networking research. Cognitive, in this context, refers to the application of perception, learning, reasoning, memory, and adaptive approaches in communication system design. The transactions welcome submissions that explore various aspects of cognitive communications and networks, focusing on innovative and holistic approaches to complex system design. Key topics covered include architecture, protocols, cross-layer design, and cognition cycle design for cognitive networks. Additionally, research on machine learning, artificial intelligence, end-to-end and distributed intelligence, software-defined networking, cognitive radios, spectrum sharing, and security and privacy issues in cognitive networks are of interest. The publication also encourages papers addressing novel services and applications enabled by these cognitive concepts.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信