Ming-Chu Chou;Cheng-Feng Hung;Chin-Ya Huang;Chih-Heng Ke
{"title":"Adaptive Throughput Optimization in Multi-Rate IEEE 802.11 WLANs via Multi-Agent Deep Reinforcement Learning","authors":"Ming-Chu Chou;Cheng-Feng Hung;Chin-Ya Huang;Chih-Heng Ke","doi":"10.1109/OJCOMS.2025.3580886","DOIUrl":null,"url":null,"abstract":"As wireless networks become increasingly important in modern society, their application scenarios are becoming more diverse and complex. However, the heterogeneity of nodes and transmission conditions presents significant challenges to existing wireless strategies and traditional centralized AI methods, making it difficult to meet user demands for network throughput. This paper proposes a distributed architecture based on multi-agent reinforcement learning combined with deep reinforcement learning. Agents are deployed on individual transmission nodes, enabling distributed observation and autonomous decision-making, while the access point provides feedback derived from the network performance resulting from their individual decisions. By experimentally comparing centralized and distributed architectures in multi-rate environments, this paper analyzes trade-offs in scalability and network performance. Additional experiments conducted under dynamic network conditions with node mobility and static scenarios involving a larger number of coexisting nodes further validate the system’s robustness and adaptability. The analysis of training loss trends shows that although the distributed architecture incurs a higher training cost, it achieves improved throughput. In particular, the distributed method outperforms the centralized method by nearly 30% when the number of nodes is relatively small, and maintains a 5–10% performance advantage as the network continues to scale.","PeriodicalId":33803,"journal":{"name":"IEEE Open Journal of the Communications Society","volume":"6 ","pages":"5384-5394"},"PeriodicalIF":6.3000,"publicationDate":"2025-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11039654","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Open Journal of the Communications Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11039654/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
As wireless networks become increasingly important in modern society, their application scenarios are becoming more diverse and complex. However, the heterogeneity of nodes and transmission conditions presents significant challenges to existing wireless strategies and traditional centralized AI methods, making it difficult to meet user demands for network throughput. This paper proposes a distributed architecture based on multi-agent reinforcement learning combined with deep reinforcement learning. Agents are deployed on individual transmission nodes, enabling distributed observation and autonomous decision-making, while the access point provides feedback derived from the network performance resulting from their individual decisions. By experimentally comparing centralized and distributed architectures in multi-rate environments, this paper analyzes trade-offs in scalability and network performance. Additional experiments conducted under dynamic network conditions with node mobility and static scenarios involving a larger number of coexisting nodes further validate the system’s robustness and adaptability. The analysis of training loss trends shows that although the distributed architecture incurs a higher training cost, it achieves improved throughput. In particular, the distributed method outperforms the centralized method by nearly 30% when the number of nodes is relatively small, and maintains a 5–10% performance advantage as the network continues to scale.
期刊介绍:
The IEEE Open Journal of the Communications Society (OJ-COMS) is an open access, all-electronic journal that publishes original high-quality manuscripts on advances in the state of the art of telecommunications systems and networks. The papers in IEEE OJ-COMS are included in Scopus. Submissions reporting new theoretical findings (including novel methods, concepts, and studies) and practical contributions (including experiments and development of prototypes) are welcome. Additionally, survey and tutorial articles are considered. The IEEE OJCOMS received its debut impact factor of 7.9 according to the Journal Citation Reports (JCR) 2023.
The IEEE Open Journal of the Communications Society covers science, technology, applications and standards for information organization, collection and transfer using electronic, optical and wireless channels and networks. Some specific areas covered include:
Systems and network architecture, control and management
Protocols, software, and middleware
Quality of service, reliability, and security
Modulation, detection, coding, and signaling
Switching and routing
Mobile and portable communications
Terminals and other end-user devices
Networks for content distribution and distributed computing
Communications-based distributed resources control.