基于深度强化学习的ris辅助广播无源物联网共生系统相移和反射系数联合优化

IF 5.9 1区 计算机科学 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
IEEE Transactions on Broadcasting Pub Date : 2026-09-01 Epub Date: 2026-03-13 DOI:10.1109/TBC.2026.3691658
Qiang Liu;Sen Xu;Hua Xu
{"title":"基于深度强化学习的ris辅助广播无源物联网共生系统相移和反射系数联合优化","authors":"Qiang Liu;Sen Xu;Hua Xu","doi":"10.1109/TBC.2026.3691658","DOIUrl":null,"url":null,"abstract":"Broadcast-passive Internet of Things (IoT) symbiotic systems exploit ambient broadcast signals to simultaneously power passive devices and support their information transmission through backscatter communication. However, these systems still suffer from severe double-hop fading, limited coverage, and complex interference coordination between broadcast and passive IoT communications. This paper proposes a reconfigurable intelligent surface (RIS)-assisted system architecture and formulates a joint optimization problem of RIS phase shifts and passive device reflection coefficient to maximize passive IoT throughput, subject to broadcast receiver quality-of-service (QoS) and passive device energy harvesting constraints. Given the non-convex and coupled nature of the formulated problem, we develop a deep reinforcement learning (DRL) framework based on proximal policy optimization (PPO), incorporating a power-domain state space representation and a piecewise reward function to balance throughput maximization with multi-constraint satisfaction. Simulation results demonstrate that the proposed scheme achieves significant throughput gains with increasing RIS elements, while the PPO agent learns to push the operating point toward active constraint boundaries, achieving an effective balance among throughput maximization, broadcast QoS protection, and energy sustainability.","PeriodicalId":13159,"journal":{"name":"IEEE Transactions on Broadcasting","volume":"72 3","pages":"826-835"},"PeriodicalIF":5.9000,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning-Based Joint Phase Shift and Reflection Coefficient Optimization for RIS-Assisted Broadcast-Passive IoT Symbiotic Systems\",\"authors\":\"Qiang Liu;Sen Xu;Hua Xu\",\"doi\":\"10.1109/TBC.2026.3691658\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Broadcast-passive Internet of Things (IoT) symbiotic systems exploit ambient broadcast signals to simultaneously power passive devices and support their information transmission through backscatter communication. However, these systems still suffer from severe double-hop fading, limited coverage, and complex interference coordination between broadcast and passive IoT communications. This paper proposes a reconfigurable intelligent surface (RIS)-assisted system architecture and formulates a joint optimization problem of RIS phase shifts and passive device reflection coefficient to maximize passive IoT throughput, subject to broadcast receiver quality-of-service (QoS) and passive device energy harvesting constraints. Given the non-convex and coupled nature of the formulated problem, we develop a deep reinforcement learning (DRL) framework based on proximal policy optimization (PPO), incorporating a power-domain state space representation and a piecewise reward function to balance throughput maximization with multi-constraint satisfaction. Simulation results demonstrate that the proposed scheme achieves significant throughput gains with increasing RIS elements, while the PPO agent learns to push the operating point toward active constraint boundaries, achieving an effective balance among throughput maximization, broadcast QoS protection, and energy sustainability.\",\"PeriodicalId\":13159,\"journal\":{\"name\":\"IEEE Transactions on Broadcasting\",\"volume\":\"72 3\",\"pages\":\"826-835\"},\"PeriodicalIF\":5.9000,\"publicationDate\":\"2026-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Broadcasting\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11517405/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2026/3/13 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Broadcasting","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11517405/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/3/13 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

广播无源物联网(IoT)共生系统利用环境广播信号同时为无源设备供电,并通过反向散射通信支持其信息传输。然而,这些系统仍然受到严重的双跳衰落、有限的覆盖以及广播和无源物联网通信之间复杂的干扰协调的影响。本文提出了一种可重构智能表面(RIS)辅助系统架构,并制定了RIS相移和无源设备反射系数的联合优化问题,以最大限度地提高无源物联网吞吐量,同时受广播接收器服务质量(QoS)和无源设备能量收集约束。鉴于该问题的非凸性和耦合性,我们开发了一个基于近端策略优化(PPO)的深度强化学习(DRL)框架,结合幂域状态空间表示和分段奖励函数来平衡吞吐量最大化和多约束满足。仿真结果表明,随着RIS元素的增加,该方案获得了显著的吞吐量增益,而PPO代理学习将工作点推向主动约束边界,实现了吞吐量最大化、广播QoS保护和能量可持续性之间的有效平衡。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep Reinforcement Learning-Based Joint Phase Shift and Reflection Coefficient Optimization for RIS-Assisted Broadcast-Passive IoT Symbiotic Systems
Broadcast-passive Internet of Things (IoT) symbiotic systems exploit ambient broadcast signals to simultaneously power passive devices and support their information transmission through backscatter communication. However, these systems still suffer from severe double-hop fading, limited coverage, and complex interference coordination between broadcast and passive IoT communications. This paper proposes a reconfigurable intelligent surface (RIS)-assisted system architecture and formulates a joint optimization problem of RIS phase shifts and passive device reflection coefficient to maximize passive IoT throughput, subject to broadcast receiver quality-of-service (QoS) and passive device energy harvesting constraints. Given the non-convex and coupled nature of the formulated problem, we develop a deep reinforcement learning (DRL) framework based on proximal policy optimization (PPO), incorporating a power-domain state space representation and a piecewise reward function to balance throughput maximization with multi-constraint satisfaction. Simulation results demonstrate that the proposed scheme achieves significant throughput gains with increasing RIS elements, while the PPO agent learns to push the operating point toward active constraint boundaries, achieving an effective balance among throughput maximization, broadcast QoS protection, and energy sustainability.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Broadcasting
IEEE Transactions on Broadcasting 工程技术-电信学
CiteScore
9.40
自引率
31.10%
发文量
79
审稿时长
6-12 weeks
期刊介绍: The Society’s Field of Interest is “Devices, equipment, techniques and systems related to broadcast technology, including the production, distribution, transmission, and propagation aspects.” In addition to this formal FOI statement, which is used to provide guidance to the Publications Committee in the selection of content, the AdCom has further resolved that “broadcast systems includes all aspects of transmission, propagation, and reception.”
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书