{"title":"带辅助语义的无线图像传输深度联合源信道编码","authors":"Jianxin Feng, Ge Cao, Junqi Liu, Zumin Wang, Zhiguo Liu, Yuanming Ding","doi":"10.1016/j.phycom.2025.102836","DOIUrl":null,"url":null,"abstract":"<div><div>Semantic communication, as an emerging paradigm, has achieved significant success by combining deep learning (DL) with joint source-channel coding (DeepJSCC). However, Current methods struggle to fully adapt to the dynamic complexity of semantic information, often suffering from loss of key details due to feature homogeneity and insufficient noise robustness during transmission, especially in environments with low signal-to-noise ratio (SNR) and high compression scenarios (CR). Therefore, we propose a novel dual-semantic framework for semantic communication, the deep joint source-channel coding for wireless image transmission with auxiliary semantics (SAJSCC), which employs a guidance vector generation network (GVNet) to extract image-specific guidance vectors, and explicitly constructs complementary spaces for the primary feature stream and auxiliary semantics. The decoder integrates a hierarchical feature guidance mechanism, adopting dual decoding strategies to dynamically balance computational efficiency and reconstruction fidelity. Furthermore, we design a concurrent channel-and-spatial attention module (CCSAM) that suppresses noise interference through joint channel–spatial re-weighting. Experimental evaluations show that the proposed SAJSCC framework significantly surpasses existing approaches, delivering a peak signal-to-noise ratio (PSNR) gain of 5.02 dB and a structural similarity index measure (SSIM) improvement of 0.15 under 0 dB SNR conditions. Our framework significantly enhances the recovery of complex textures, establishing a new paradigm for highly robust semantic communication.</div></div>","PeriodicalId":48707,"journal":{"name":"Physical Communication","volume":"73 ","pages":"Article 102836"},"PeriodicalIF":2.2000,"publicationDate":"2025-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep joint source-channel coding for wireless image transmission with auxiliary semantics\",\"authors\":\"Jianxin Feng, Ge Cao, Junqi Liu, Zumin Wang, Zhiguo Liu, Yuanming Ding\",\"doi\":\"10.1016/j.phycom.2025.102836\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Semantic communication, as an emerging paradigm, has achieved significant success by combining deep learning (DL) with joint source-channel coding (DeepJSCC). However, Current methods struggle to fully adapt to the dynamic complexity of semantic information, often suffering from loss of key details due to feature homogeneity and insufficient noise robustness during transmission, especially in environments with low signal-to-noise ratio (SNR) and high compression scenarios (CR). Therefore, we propose a novel dual-semantic framework for semantic communication, the deep joint source-channel coding for wireless image transmission with auxiliary semantics (SAJSCC), which employs a guidance vector generation network (GVNet) to extract image-specific guidance vectors, and explicitly constructs complementary spaces for the primary feature stream and auxiliary semantics. The decoder integrates a hierarchical feature guidance mechanism, adopting dual decoding strategies to dynamically balance computational efficiency and reconstruction fidelity. Furthermore, we design a concurrent channel-and-spatial attention module (CCSAM) that suppresses noise interference through joint channel–spatial re-weighting. Experimental evaluations show that the proposed SAJSCC framework significantly surpasses existing approaches, delivering a peak signal-to-noise ratio (PSNR) gain of 5.02 dB and a structural similarity index measure (SSIM) improvement of 0.15 under 0 dB SNR conditions. Our framework significantly enhances the recovery of complex textures, establishing a new paradigm for highly robust semantic communication.</div></div>\",\"PeriodicalId\":48707,\"journal\":{\"name\":\"Physical Communication\",\"volume\":\"73 \",\"pages\":\"Article 102836\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2025-09-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physical Communication\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1874490725002393\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physical Communication","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1874490725002393","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Deep joint source-channel coding for wireless image transmission with auxiliary semantics
Semantic communication, as an emerging paradigm, has achieved significant success by combining deep learning (DL) with joint source-channel coding (DeepJSCC). However, Current methods struggle to fully adapt to the dynamic complexity of semantic information, often suffering from loss of key details due to feature homogeneity and insufficient noise robustness during transmission, especially in environments with low signal-to-noise ratio (SNR) and high compression scenarios (CR). Therefore, we propose a novel dual-semantic framework for semantic communication, the deep joint source-channel coding for wireless image transmission with auxiliary semantics (SAJSCC), which employs a guidance vector generation network (GVNet) to extract image-specific guidance vectors, and explicitly constructs complementary spaces for the primary feature stream and auxiliary semantics. The decoder integrates a hierarchical feature guidance mechanism, adopting dual decoding strategies to dynamically balance computational efficiency and reconstruction fidelity. Furthermore, we design a concurrent channel-and-spatial attention module (CCSAM) that suppresses noise interference through joint channel–spatial re-weighting. Experimental evaluations show that the proposed SAJSCC framework significantly surpasses existing approaches, delivering a peak signal-to-noise ratio (PSNR) gain of 5.02 dB and a structural similarity index measure (SSIM) improvement of 0.15 under 0 dB SNR conditions. Our framework significantly enhances the recovery of complex textures, establishing a new paradigm for highly robust semantic communication.
期刊介绍:
PHYCOM: Physical Communication is an international and archival journal providing complete coverage of all topics of interest to those involved in all aspects of physical layer communications. Theoretical research contributions presenting new techniques, concepts or analyses, applied contributions reporting on experiences and experiments, and tutorials are published.
Topics of interest include but are not limited to:
Physical layer issues of Wireless Local Area Networks, WiMAX, Wireless Mesh Networks, Sensor and Ad Hoc Networks, PCS Systems; Radio access protocols and algorithms for the physical layer; Spread Spectrum Communications; Channel Modeling; Detection and Estimation; Modulation and Coding; Multiplexing and Carrier Techniques; Broadband Wireless Communications; Wireless Personal Communications; Multi-user Detection; Signal Separation and Interference rejection: Multimedia Communications over Wireless; DSP Applications to Wireless Systems; Experimental and Prototype Results; Multiple Access Techniques; Space-time Processing; Synchronization Techniques; Error Control Techniques; Cryptography; Software Radios; Tracking; Resource Allocation and Inference Management; Multi-rate and Multi-carrier Communications; Cross layer Design and Optimization; Propagation and Channel Characterization; OFDM Systems; MIMO Systems; Ultra-Wideband Communications; Cognitive Radio System Architectures; Platforms and Hardware Implementations for the Support of Cognitive, Radio Systems; Cognitive Radio Resource Management and Dynamic Spectrum Sharing.