基于多智能体深度强化学习的多速率IEEE 802.11 wlan自适应吞吐量优化

IF 6.3 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Ming-Chu Chou;Cheng-Feng Hung;Chin-Ya Huang;Chih-Heng Ke
{"title":"基于多智能体深度强化学习的多速率IEEE 802.11 wlan自适应吞吐量优化","authors":"Ming-Chu Chou;Cheng-Feng Hung;Chin-Ya Huang;Chih-Heng Ke","doi":"10.1109/OJCOMS.2025.3580886","DOIUrl":null,"url":null,"abstract":"As wireless networks become increasingly important in modern society, their application scenarios are becoming more diverse and complex. However, the heterogeneity of nodes and transmission conditions presents significant challenges to existing wireless strategies and traditional centralized AI methods, making it difficult to meet user demands for network throughput. This paper proposes a distributed architecture based on multi-agent reinforcement learning combined with deep reinforcement learning. Agents are deployed on individual transmission nodes, enabling distributed observation and autonomous decision-making, while the access point provides feedback derived from the network performance resulting from their individual decisions. By experimentally comparing centralized and distributed architectures in multi-rate environments, this paper analyzes trade-offs in scalability and network performance. Additional experiments conducted under dynamic network conditions with node mobility and static scenarios involving a larger number of coexisting nodes further validate the system’s robustness and adaptability. The analysis of training loss trends shows that although the distributed architecture incurs a higher training cost, it achieves improved throughput. In particular, the distributed method outperforms the centralized method by nearly 30% when the number of nodes is relatively small, and maintains a 5–10% performance advantage as the network continues to scale.","PeriodicalId":33803,"journal":{"name":"IEEE Open Journal of the Communications Society","volume":"6 ","pages":"5384-5394"},"PeriodicalIF":6.3000,"publicationDate":"2025-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11039654","citationCount":"0","resultStr":"{\"title\":\"Adaptive Throughput Optimization in Multi-Rate IEEE 802.11 WLANs via Multi-Agent Deep Reinforcement Learning\",\"authors\":\"Ming-Chu Chou;Cheng-Feng Hung;Chin-Ya Huang;Chih-Heng Ke\",\"doi\":\"10.1109/OJCOMS.2025.3580886\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As wireless networks become increasingly important in modern society, their application scenarios are becoming more diverse and complex. However, the heterogeneity of nodes and transmission conditions presents significant challenges to existing wireless strategies and traditional centralized AI methods, making it difficult to meet user demands for network throughput. This paper proposes a distributed architecture based on multi-agent reinforcement learning combined with deep reinforcement learning. Agents are deployed on individual transmission nodes, enabling distributed observation and autonomous decision-making, while the access point provides feedback derived from the network performance resulting from their individual decisions. By experimentally comparing centralized and distributed architectures in multi-rate environments, this paper analyzes trade-offs in scalability and network performance. Additional experiments conducted under dynamic network conditions with node mobility and static scenarios involving a larger number of coexisting nodes further validate the system’s robustness and adaptability. The analysis of training loss trends shows that although the distributed architecture incurs a higher training cost, it achieves improved throughput. In particular, the distributed method outperforms the centralized method by nearly 30% when the number of nodes is relatively small, and maintains a 5–10% performance advantage as the network continues to scale.\",\"PeriodicalId\":33803,\"journal\":{\"name\":\"IEEE Open Journal of the Communications Society\",\"volume\":\"6 \",\"pages\":\"5384-5394\"},\"PeriodicalIF\":6.3000,\"publicationDate\":\"2025-06-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11039654\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Open Journal of the Communications Society\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11039654/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Open Journal of the Communications Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11039654/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

随着无线网络在现代社会中的地位日益重要,其应用场景也越来越多样和复杂。然而,节点和传输条件的异构性对现有的无线策略和传统的集中式人工智能方法提出了重大挑战,难以满足用户对网络吞吐量的需求。本文提出了一种基于多智能体强化学习和深度强化学习相结合的分布式体系结构。代理部署在单独的传输节点上,支持分布式观察和自主决策,而接入点提供来自其单独决策所产生的网络性能的反馈。通过实验比较多速率环境下集中式和分布式架构,分析了可扩展性和网络性能的权衡。在具有节点移动性的动态网络条件和包含大量节点共存的静态场景下进行的附加实验进一步验证了系统的鲁棒性和适应性。对训练损失趋势的分析表明,分布式架构虽然增加了训练成本,但提高了吞吐量。特别是,当节点数量相对较少时,分布式方法的性能优于集中式方法近30%,并且随着网络的持续扩展保持5-10%的性能优势。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Adaptive Throughput Optimization in Multi-Rate IEEE 802.11 WLANs via Multi-Agent Deep Reinforcement Learning
As wireless networks become increasingly important in modern society, their application scenarios are becoming more diverse and complex. However, the heterogeneity of nodes and transmission conditions presents significant challenges to existing wireless strategies and traditional centralized AI methods, making it difficult to meet user demands for network throughput. This paper proposes a distributed architecture based on multi-agent reinforcement learning combined with deep reinforcement learning. Agents are deployed on individual transmission nodes, enabling distributed observation and autonomous decision-making, while the access point provides feedback derived from the network performance resulting from their individual decisions. By experimentally comparing centralized and distributed architectures in multi-rate environments, this paper analyzes trade-offs in scalability and network performance. Additional experiments conducted under dynamic network conditions with node mobility and static scenarios involving a larger number of coexisting nodes further validate the system’s robustness and adaptability. The analysis of training loss trends shows that although the distributed architecture incurs a higher training cost, it achieves improved throughput. In particular, the distributed method outperforms the centralized method by nearly 30% when the number of nodes is relatively small, and maintains a 5–10% performance advantage as the network continues to scale.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
13.70
自引率
3.80%
发文量
94
审稿时长
10 weeks
期刊介绍: The IEEE Open Journal of the Communications Society (OJ-COMS) is an open access, all-electronic journal that publishes original high-quality manuscripts on advances in the state of the art of telecommunications systems and networks. The papers in IEEE OJ-COMS are included in Scopus. Submissions reporting new theoretical findings (including novel methods, concepts, and studies) and practical contributions (including experiments and development of prototypes) are welcome. Additionally, survey and tutorial articles are considered. The IEEE OJCOMS received its debut impact factor of 7.9 according to the Journal Citation Reports (JCR) 2023. The IEEE Open Journal of the Communications Society covers science, technology, applications and standards for information organization, collection and transfer using electronic, optical and wireless channels and networks. Some specific areas covered include: Systems and network architecture, control and management Protocols, software, and middleware Quality of service, reliability, and security Modulation, detection, coding, and signaling Switching and routing Mobile and portable communications Terminals and other end-user devices Networks for content distribution and distributed computing Communications-based distributed resources control.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信