{"title":"Using Reinforcement Learning and Game Theory for Determining Cooperative Nodes in Multi-hop Wireless Networks","authors":"Fahimeh Rashidjafari , Nahideh Derakhshanfard , Behrouz Shahrokhzadeh , Ali Ghaffari","doi":"10.1016/j.adhoc.2025.103969","DOIUrl":null,"url":null,"abstract":"<div><div>Multi-hop wireless networks, such as ad hoc and IoT networks, contain relay nodes offering packet relay between sources and destinations. Ensuring energy efficiency, minimizing delay, and maintaining reliable routing remain supreme challenges, especially when node cooperation is essential in guaranteeing network survivability. Unlike traditional approaches that assess cooperation globally and concerning the origin, this work proposes a new approach that detects cooperative nodes on a per-destination basis using a hybrid framework based on reinforcement learning and game theory. In the proposed framework, every node is an independent agent that learns optimal routing policies through ongoing interactions. Reinforcement learning allows dynamic adaptation, while game-theoretic modeling achieves incentive compatibility through payment for cooperative behavior and punishment for selfishness. Simulation results demonstrate that the algorithm presented outperforms benchmark algorithms including HChOA, QoS-RSIA, RL-based, and DQN-RSS. The suggested approach attains a 20% lessening in energy consumption, a 37.5% reduction in average delay, a 10.6% betterment in packet delivery ratio, a 14.1% improvement in cooperation ratio, and a 17.5% improvement in network lifetime. These enhancements validate the efficacy of the suggested approach in improving routing performance, reducing energy consumption, and guaranteeing reliability in dynamic multi-hop wireless networks.</div></div>","PeriodicalId":55555,"journal":{"name":"Ad Hoc Networks","volume":"178 ","pages":"Article 103969"},"PeriodicalIF":4.8000,"publicationDate":"2025-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ad Hoc Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1570870525002173","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Multi-hop wireless networks, such as ad hoc and IoT networks, contain relay nodes offering packet relay between sources and destinations. Ensuring energy efficiency, minimizing delay, and maintaining reliable routing remain supreme challenges, especially when node cooperation is essential in guaranteeing network survivability. Unlike traditional approaches that assess cooperation globally and concerning the origin, this work proposes a new approach that detects cooperative nodes on a per-destination basis using a hybrid framework based on reinforcement learning and game theory. In the proposed framework, every node is an independent agent that learns optimal routing policies through ongoing interactions. Reinforcement learning allows dynamic adaptation, while game-theoretic modeling achieves incentive compatibility through payment for cooperative behavior and punishment for selfishness. Simulation results demonstrate that the algorithm presented outperforms benchmark algorithms including HChOA, QoS-RSIA, RL-based, and DQN-RSS. The suggested approach attains a 20% lessening in energy consumption, a 37.5% reduction in average delay, a 10.6% betterment in packet delivery ratio, a 14.1% improvement in cooperation ratio, and a 17.5% improvement in network lifetime. These enhancements validate the efficacy of the suggested approach in improving routing performance, reducing energy consumption, and guaranteeing reliability in dynamic multi-hop wireless networks.
期刊介绍:
The Ad Hoc Networks is an international and archival journal providing a publication vehicle for complete coverage of all topics of interest to those involved in ad hoc and sensor networking areas. The Ad Hoc Networks considers original, high quality and unpublished contributions addressing all aspects of ad hoc and sensor networks. Specific areas of interest include, but are not limited to:
Mobile and Wireless Ad Hoc Networks
Sensor Networks
Wireless Local and Personal Area Networks
Home Networks
Ad Hoc Networks of Autonomous Intelligent Systems
Novel Architectures for Ad Hoc and Sensor Networks
Self-organizing Network Architectures and Protocols
Transport Layer Protocols
Routing protocols (unicast, multicast, geocast, etc.)
Media Access Control Techniques
Error Control Schemes
Power-Aware, Low-Power and Energy-Efficient Designs
Synchronization and Scheduling Issues
Mobility Management
Mobility-Tolerant Communication Protocols
Location Tracking and Location-based Services
Resource and Information Management
Security and Fault-Tolerance Issues
Hardware and Software Platforms, Systems, and Testbeds
Experimental and Prototype Results
Quality-of-Service Issues
Cross-Layer Interactions
Scalability Issues
Performance Analysis and Simulation of Protocols.