Deep contextual bandits-based energy-efficient beamforming for integrated sensing and communication

IF 2 4区计算机科学 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC

Physical Communication Pub Date : 2025-02-01 DOI:10.1016/j.phycom.2024.102576

Mohammad Amin Choukali, Sedighe Mirbolouk, Morteza Valizadeh, Mehdi Chehel Amirani

{"title":"Deep contextual bandits-based energy-efficient beamforming for integrated sensing and communication","authors":"Mohammad Amin Choukali, Sedighe Mirbolouk, Morteza Valizadeh, Mehdi Chehel Amirani","doi":"10.1016/j.phycom.2024.102576","DOIUrl":null,"url":null,"abstract":"<div><div>In this paper, a transmit beamforming design is considered to jointly improve the communication and sensing functionalities in an integrated sensing and communication (ISAC) system, where a dual-functional base station (BS) serves a set of communication users (UEs) while sensing some potential targets (TGs). To this end, a multi-objective beamforming optimization problem is formulated to maximize the weighted linear combination of the communication energy efficiency (EE) and sensing beampattern gains. Using the normalized weighted sum method, the multi-objective problem is relaxed to a single-objective problem. For dealing with the non-convexity nature of the considered problem and the continuity of the beamforming space, a novel deep contextual bandits (DCB) scheme inspired by the soft actor–critic (S-DCB) method is proposed in which the channel state information of UEs is used as the context. Both the reward and policy functions are approximated to solve the problem. Simulation results indicate that the multi-objective function enables an adjustable trade-off between the communication and sensing functionalities. Besides, the effectiveness of the proposed S-DCB algorithm is verified through a comprehensive comparison with the state-of-the-art DCB-DDPG and the upper bound benchmarks.</div></div>","PeriodicalId":48707,"journal":{"name":"Physical Communication","volume":"68 ","pages":"Article 102576"},"PeriodicalIF":2.0000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physical Communication","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1874490724002945","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}

引用次数: 0

Abstract

In this paper, a transmit beamforming design is considered to jointly improve the communication and sensing functionalities in an integrated sensing and communication (ISAC) system, where a dual-functional base station (BS) serves a set of communication users (UEs) while sensing some potential targets (TGs). To this end, a multi-objective beamforming optimization problem is formulated to maximize the weighted linear combination of the communication energy efficiency (EE) and sensing beampattern gains. Using the normalized weighted sum method, the multi-objective problem is relaxed to a single-objective problem. For dealing with the non-convexity nature of the considered problem and the continuity of the beamforming space, a novel deep contextual bandits (DCB) scheme inspired by the soft actor–critic (S-DCB) method is proposed in which the channel state information of UEs is used as the context. Both the reward and policy functions are approximated to solve the problem. Simulation results indicate that the multi-objective function enables an adjustable trade-off between the communication and sensing functionalities. Besides, the effectiveness of the proposed S-DCB algorithm is verified through a comprehensive comparison with the state-of-the-art DCB-DDPG and the upper bound benchmarks.

查看原文本刊更多论文

基于深度上下文强盗的集成传感与通信高能效波束形成

在集成传感与通信（ISAC）系统中，双功能基站（BS）服务于一组通信用户（ue），同时感知一些潜在目标（tg），本文考虑了一种发射波束成形设计，以共同提高通信和传感功能。为此，建立了一个多目标波束形成优化问题，以最大化通信能量效率（EE）和传感波束图增益的加权线性组合。利用归一化加权和方法，将多目标问题简化为单目标问题。针对所考虑问题的非凸性和波束形成空间的连续性，提出了一种以ue的信道状态信息作为上下文的受软actor-critic （S-DCB）方法启发的深度上下文强盗（deep contextual bandits， DCB）方案。为了解决这个问题，我们对奖励函数和策略函数都进行了近似。仿真结果表明，该多目标函数能够在通信和传感功能之间实现可调节的权衡。此外，通过与最先进的DCB-DDPG和上界基准的综合比较，验证了所提S-DCB算法的有效性。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Physical Communication ENGINEERING, ELECTRICAL & ELECTRONICTELECO-TELECOMMUNICATIONS

CiteScore

5.00

自引率

9.10%

发文量

212

审稿时长

55 days

期刊介绍： PHYCOM: Physical Communication is an international and archival journal providing complete coverage of all topics of interest to those involved in all aspects of physical layer communications. Theoretical research contributions presenting new techniques, concepts or analyses, applied contributions reporting on experiences and experiments, and tutorials are published. Topics of interest include but are not limited to: Physical layer issues of Wireless Local Area Networks, WiMAX, Wireless Mesh Networks, Sensor and Ad Hoc Networks, PCS Systems; Radio access protocols and algorithms for the physical layer; Spread Spectrum Communications; Channel Modeling; Detection and Estimation; Modulation and Coding; Multiplexing and Carrier Techniques; Broadband Wireless Communications; Wireless Personal Communications; Multi-user Detection; Signal Separation and Interference rejection: Multimedia Communications over Wireless; DSP Applications to Wireless Systems; Experimental and Prototype Results; Multiple Access Techniques; Space-time Processing; Synchronization Techniques; Error Control Techniques; Cryptography; Software Radios; Tracking; Resource Allocation and Inference Management; Multi-rate and Multi-carrier Communications; Cross layer Design and Optimization; Propagation and Channel Characterization; OFDM Systems; MIMO Systems; Ultra-Wideband Communications; Cognitive Radio System Architectures; Platforms and Hardware Implementations for the Support of Cognitive, Radio Systems; Cognitive Radio Resource Management and Dynamic Spectrum Sharing.