Research on Semantic Communication Based on Joint Control Mechanism of Shallow and Deep Neural Network

Abstract

With the rapid development of deep learning, various semantic communication models are emerging, but the current semantic communication models still have much room for improvement in the coding layer. For this reason, a joint-residual neural networks (Joint-ResNets) framework based on the joint control of shallow neural networks (SNNs) and deep neural networks (DNNs) is proposed to cope with the problems in semantic communication coding. The framework synergizes SNNs and DNNs based on their shared utility, and uses variable weight α term to control the ratio of SNNs and DNNs to fully utilize the simplicity of SNNs and the richness of DNNs. The article details the construction of the Joint-ResNets framework and its canonical use in classical semantic communication models, and illustrates the control mechanism of the variable weight α term in the Joint-ResNets framework and its importance in balancing the model complexity between SNNs and DNNs. The article takes the task-oriented communication model in the device edge collaborative reasoning system as an example for experimentation and analysis. The experimental validation shows that DNNs and SNNs can be combined in a more effective way to standardize semantic coding, which improves the overall predictive performance, interpretability, and robustness of semantic communication models, and this framework is expected to bring new breakthroughs in the field of semantic communication.