{"title":"Computation and transmission adaptive semantic communication for reliability-guarantee image reconstruction in IoT","authors":"Chen Lin, Yijun Guo, Jianjun Hao, Zhilong Zhang","doi":"10.1016/j.iot.2024.101383","DOIUrl":null,"url":null,"abstract":"<div><div>Semantic communication can significantly compress source data, improving transmission efficiency. However, semantic communication systems under varying channel condition have not been well studied, especially for tasks that require reliability guarantee. This paper focus on the reliability-guarantee image reconstruction tasks, and study the computation and transmission adaptive semantic communication. First, a computation and transmission adaptive semantic communication (CTASC) system is proposed. It is able to adjust the computation load and transmission load of an image reconstruction task adaptively while guaranteeing the reconstruction reliability. Specifically, a semantic encoder with multiple convolutional neural network (CNN) slices with different network depths is designed to adjust the transmission load and computation load. Second, a joint computation and transmission resource allocation problem aimed at minimizing the maximum delay within system is formulated. To solve this problem, we decompose it into two nested sub-problems and propose a Simulated Annealing with Re-perturbation Mechanism (SA-RPM) algorithm and an Alternating Optimization (AO) algorithm to solve these sub-problems, respectively. Simulation results demonstrate that compared to variable code length enabled DeepJSCC (DeepJSCC-V), our system can achieve higher compression ratio(CR) with similar LPIPS performance. Simulation results also show that our resource allocation scheme can obtain an approaching value to the optimal maximum delay, with an average difference not exceeding 0.2%.</div></div>","PeriodicalId":29968,"journal":{"name":"Internet of Things","volume":"28 ","pages":"Article 101383"},"PeriodicalIF":6.0000,"publicationDate":"2024-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Internet of Things","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S254266052400324X","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Semantic communication can significantly compress source data, improving transmission efficiency. However, semantic communication systems under varying channel condition have not been well studied, especially for tasks that require reliability guarantee. This paper focus on the reliability-guarantee image reconstruction tasks, and study the computation and transmission adaptive semantic communication. First, a computation and transmission adaptive semantic communication (CTASC) system is proposed. It is able to adjust the computation load and transmission load of an image reconstruction task adaptively while guaranteeing the reconstruction reliability. Specifically, a semantic encoder with multiple convolutional neural network (CNN) slices with different network depths is designed to adjust the transmission load and computation load. Second, a joint computation and transmission resource allocation problem aimed at minimizing the maximum delay within system is formulated. To solve this problem, we decompose it into two nested sub-problems and propose a Simulated Annealing with Re-perturbation Mechanism (SA-RPM) algorithm and an Alternating Optimization (AO) algorithm to solve these sub-problems, respectively. Simulation results demonstrate that compared to variable code length enabled DeepJSCC (DeepJSCC-V), our system can achieve higher compression ratio(CR) with similar LPIPS performance. Simulation results also show that our resource allocation scheme can obtain an approaching value to the optimal maximum delay, with an average difference not exceeding 0.2%.
期刊介绍:
Internet of Things; Engineering Cyber Physical Human Systems is a comprehensive journal encouraging cross collaboration between researchers, engineers and practitioners in the field of IoT & Cyber Physical Human Systems. The journal offers a unique platform to exchange scientific information on the entire breadth of technology, science, and societal applications of the IoT.
The journal will place a high priority on timely publication, and provide a home for high quality.
Furthermore, IOT is interested in publishing topical Special Issues on any aspect of IOT.