{"title":"Fusion of self-attention mechanism for CSI feedback in massive MIMO systems","authors":"Tingting Zhang , Youyun Xu , Changpeng Zhou","doi":"10.1016/j.icte.2024.10.010","DOIUrl":null,"url":null,"abstract":"<div><div>In massive MIMO systems, obtaining accurate channel state information (CSI) is crucial for optimal channel coding and beamforming. However, traditional CSI feedback methods require high bandwidth and also consume a large amount of power and computing resources. To address these challenges, several compressed sensing-based techniques have been implemented in recent years. These techniques, however, are often iterative and computationally complex to implement in power-constrained user equipment. In this paper, we propose a novel fusion of the self-attention mechanism, called <em>FSAMNet</em>, to efficiently and accurately implement the CSI feedback task for massive MIMO systems. Our proposed FSAMNet adopts both the residual connections in the attention mechanism and a sequence of depth-separable convolutional layers to enhance the model’s performance and expressive ability. Specifically, we apply a multi-layer self-attention mechanism in the encoder part to achieve feature extraction and compression. In the decoder part, we use multiple convolutional layers and self-attention mechanisms to convert the embedding vector generated by the encoder back into the original image. Experimental results show that the performance of our proposed FSAMNet outperforms conventional benchmark schemes in terms of feedback network performance.</div></div>","PeriodicalId":48526,"journal":{"name":"ICT Express","volume":"11 1","pages":"Pages 124-128"},"PeriodicalIF":4.1000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ICT Express","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2405959524001334","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
In massive MIMO systems, obtaining accurate channel state information (CSI) is crucial for optimal channel coding and beamforming. However, traditional CSI feedback methods require high bandwidth and also consume a large amount of power and computing resources. To address these challenges, several compressed sensing-based techniques have been implemented in recent years. These techniques, however, are often iterative and computationally complex to implement in power-constrained user equipment. In this paper, we propose a novel fusion of the self-attention mechanism, called FSAMNet, to efficiently and accurately implement the CSI feedback task for massive MIMO systems. Our proposed FSAMNet adopts both the residual connections in the attention mechanism and a sequence of depth-separable convolutional layers to enhance the model’s performance and expressive ability. Specifically, we apply a multi-layer self-attention mechanism in the encoder part to achieve feature extraction and compression. In the decoder part, we use multiple convolutional layers and self-attention mechanisms to convert the embedding vector generated by the encoder back into the original image. Experimental results show that the performance of our proposed FSAMNet outperforms conventional benchmark schemes in terms of feedback network performance.
期刊介绍:
The ICT Express journal published by the Korean Institute of Communications and Information Sciences (KICS) is an international, peer-reviewed research publication covering all aspects of information and communication technology. The journal aims to publish research that helps advance the theoretical and practical understanding of ICT convergence, platform technologies, communication networks, and device technologies. The technology advancement in information and communication technology (ICT) sector enables portable devices to be always connected while supporting high data rate, resulting in the recent popularity of smartphones that have a considerable impact in economic and social development.