Privacy-Preserving Interactive Semantic Codec Training for IoT-Based Holographic Counterparts

The use of IoT-based semantic codecs to process complex contextual semantic information in holographic counterparts introduces significant privacy risks, as it may expose sensitive data, thereby increasing the likelihood of privacy disclosures. The diverse and dynamic nature of holographic counterparts in IoT environments exacerbates these challenges, making it more difficult for semantic codecs to effectively safeguard data privacy. This complexity further intensifies the need for privacy-preserving computation methods, as ensuring the confidentiality and security of the data processed by these codecs becomes a critical concern. However, current privacy protection strategy for multi-party training of semantic codecs relies heavily on the central server for gradient calculation, which may lead to gradient leakage issue. To address this issue, we propose PIMSeC (Privacy-Preserving Interactive Multi-Party Semantic Codec Training for IoT-Based Holographic Counterparts), a novel encryption-based technique that facilitates secure and efficient multi-party interactive training without the dependence on the central server, which enhances both data security and privacy resilience. PIMSeC not only proposes a full interactive secure multi-party deep learning model to protect data privacy during multi-party interactive training, but also, within the above deep learning model, establishes an encrypted additive gradient noise mechanism to ensure post-training semantic codec data privacy. Our theoretical analysis and experimental results demonstrate that PIMSeC promotes semantic codecs privacy protection effectively by interactive secure multi-party training. Compared to the state-of-art methods, PIMSeC achieves a 3% to 15% improvement in terms of accuracy, precision, F1-score, and recall at lower compression rates.