Generative Semantic Communications With Foundation Models: Perception-Error Analysis and Semantic-Aware Power Allocation

Abstract

Generative foundation models can revolutionize the design of semantic communication (SemCom) systems by enabling high fidelity exchange of semantic information at ultra-low rates. In this work, a generative SemCom framework utilizing pre-trained foundation models is proposed, where both uncoded forward-with-error and coded discard-with-error schemes are developed for the semantic decoder. Using the rate-distortion-perception theory, the relationship between regenerated signal quality and transmission reliability is characterized, which is proven to be non-decreasing. Based on this, semantic values are defined to quantify the semantic similarity between multimodal semantic features and the original source. We also investigate semantic-aware power allocation problems that minimize power consumption for ultra-low rate and high fidelity SemComs. Two semantic-aware power allocation methods are proposed by leveraging the non-decreasing property of the perception-error relationship. Based on the Kodak dataset, perception-error functions and semantic values are obtained for image tasks. Simulation results show that the proposed semantic-aware method significantly outperforms conventional approaches, particularly in the channel-coded case (up to 90% power saving).