Service-aware Q-learning-based routing protocol in the underwater acoustic sensor network

IF 4.4 2区计算机科学 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE

Computer Networks Pub Date : 2025-02-01 DOI:10.1016/j.comnet.2024.110986

Shuyun Zhang , Huifang Chen , Lei Xie

{"title":"Service-aware Q-learning-based routing protocol in the underwater acoustic sensor network","authors":"Shuyun Zhang , Huifang Chen , Lei Xie","doi":"10.1016/j.comnet.2024.110986","DOIUrl":null,"url":null,"abstract":"<div><div>Due to the high bit error ratio, long propagation delay, low transmission bandwidth and limited energy of sensor nodes, designing an appropriate routing protocol is an important issue in the underwater acoustic sensor network (UASN). In this paper, a service-aware <em>Q</em>-learning-based routing (SAQR) protocol is proposed in the UASN to support the diverse services, as well as achieving an efficient routing. The proposed protocol incorporates four factors in the reward function, and selects the neighboring node with the minimum <em>Q</em> value as the next hop. In addition, a set of candidate forwarding nodes is selected from the neighboring nodes, and a holding time mechanism is addressed to facilitate opportunistic transmission and improve the packet delivery ratio (PDR). Furthermore, a routing void handling mechanism is developed to enhance the reliability of data transmission in the UASN. Simulation results show that the proposed SAQR protocol performs well, in terms of the PDR, the end-to-end delay, the energy efficiency, in the dynamic underwater network environment.</div></div>","PeriodicalId":50637,"journal":{"name":"Computer Networks","volume":"257 ","pages":"Article 110986"},"PeriodicalIF":4.4000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1389128624008181","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}

引用次数: 0

Abstract

Due to the high bit error ratio, long propagation delay, low transmission bandwidth and limited energy of sensor nodes, designing an appropriate routing protocol is an important issue in the underwater acoustic sensor network (UASN). In this paper, a service-aware Q-learning-based routing (SAQR) protocol is proposed in the UASN to support the diverse services, as well as achieving an efficient routing. The proposed protocol incorporates four factors in the reward function, and selects the neighboring node with the minimum Q value as the next hop. In addition, a set of candidate forwarding nodes is selected from the neighboring nodes, and a holding time mechanism is addressed to facilitate opportunistic transmission and improve the packet delivery ratio (PDR). Furthermore, a routing void handling mechanism is developed to enhance the reliability of data transmission in the UASN. Simulation results show that the proposed SAQR protocol performs well, in terms of the PDR, the end-to-end delay, the energy efficiency, in the dynamic underwater network environment.

查看原文本刊更多论文

求助全文

约1分钟内获得全文求助全文

来源期刊

Computer Networks 工程技术-电信学

CiteScore

10.80

自引率

3.60%

发文量

434

审稿时长

8.6 months

期刊介绍： Computer Networks is an international, archival journal providing a publication vehicle for complete coverage of all topics of interest to those involved in the computer communications networking area. The audience includes researchers, managers and operators of networks as well as designers and implementors. The Editorial Board will consider any material for publication that is of interest to those groups.