Improved dDQL: A Double Deep Q-Learning Enabled Localization for Internet of Underwater Things

IF 2.5 4区计算机科学 Q3 TELECOMMUNICATIONS

Transactions on Emerging Telecommunications Technologies Pub Date : 2025-06-25 DOI:10.1002/ett.70207

Nellore Kapileswar, Judy Simon, Polasi Phani Kumar, Thomas M Chen, Sathiyanarayanan Mithileysh

{"title":"Improved dDQL: A Double Deep Q-Learning Enabled Localization for Internet of Underwater Things","authors":"Nellore Kapileswar, Judy Simon, Polasi Phani Kumar, Thomas M Chen, Sathiyanarayanan Mithileysh","doi":"10.1002/ett.70207","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Reliable sensor node localization is essential for internet of underwater things (IoUT) applications because it allows management, communication, and sensing in large, uncharted oceanic environments. This research focuses on developing a learning-enabled node localization model for IoUT using autonomous underwater vehicles (AUVs). To estimate the locations of AUVs, active and passive sensor nodes, a double deep Q-learning (dDQL) based localization algorithm is introduced. AUVs serve as mobile anchor nodes, and the algorithm uses an online value iteration process to optimize node locations. Active sensor nodes initiate the localization process by transmitting messages, whereas passive sensor nodes determine their location without sending signals. Furthermore, the proposed algorithm for exaggerated crayfish optimization (ExCo) utilizes the selection of optimal actions. The proposed dDQL with ExCo acquired RMSE, localization error, time, delay, throughput, and energy consumption of 1.44E-07 m, 7.19E-08 m, 16153.16 s, 13.08 s, 0.98 bps, and 0.35 J, respectively.</p>\n </div>","PeriodicalId":23282,"journal":{"name":"Transactions on Emerging Telecommunications Technologies","volume":"36 7","pages":""},"PeriodicalIF":2.5000,"publicationDate":"2025-06-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transactions on Emerging Telecommunications Technologies","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/ett.70207","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}

引用次数: 0

Abstract

Reliable sensor node localization is essential for internet of underwater things (IoUT) applications because it allows management, communication, and sensing in large, uncharted oceanic environments. This research focuses on developing a learning-enabled node localization model for IoUT using autonomous underwater vehicles (AUVs). To estimate the locations of AUVs, active and passive sensor nodes, a double deep Q-learning (dDQL) based localization algorithm is introduced. AUVs serve as mobile anchor nodes, and the algorithm uses an online value iteration process to optimize node locations. Active sensor nodes initiate the localization process by transmitting messages, whereas passive sensor nodes determine their location without sending signals. Furthermore, the proposed algorithm for exaggerated crayfish optimization (ExCo) utilizes the selection of optimal actions. The proposed dDQL with ExCo acquired RMSE, localization error, time, delay, throughput, and energy consumption of 1.44E-07 m, 7.19E-08 m, 16153.16 s, 13.08 s, 0.98 bps, and 0.35 J, respectively.

Abstract Image

查看原文本刊更多论文

改进的dDQL：双深度q -学习支持的水下物联网定位

可靠的传感器节点定位对于水下物联网（IoUT）应用至关重要，因为它允许在大型未知海洋环境中进行管理、通信和传感。本研究的重点是开发一种基于自主水下航行器（auv）的IoUT节点学习定位模型。为了估计auv、主动和被动传感器节点的位置，引入了一种基于双深度q -学习（dDQL）的定位算法。auv作为移动锚节点，算法采用在线值迭代过程优化节点位置。主动传感器节点通过发送消息来启动定位过程，而被动传感器节点不发送信号来确定其位置。此外，该算法还利用了最优行为的选择来实现夸张小龙虾优化（ExCo）。基于ExCo的dDQL的RMSE、定位误差、时间、延迟、吞吐量和能耗分别为1.44E-07 m、7.19E-08 m、16153.16 s、13.08 s、0.98 bps和0.35 J。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Transactions on Emerging Telecommunications Technologies TELECOMMUNICATIONS-

CiteScore

8.90

自引率

13.90%

发文量

249

期刊介绍： ransactions on Emerging Telecommunications Technologies (ETT), formerly known as European Transactions on Telecommunications (ETT), has the following aims: - to attract cutting-edge publications from leading researchers and research groups around the world - to become a highly cited source of timely research findings in emerging fields of telecommunications - to limit revision and publication cycles to a few months and thus significantly increase attractiveness to publish - to become the leading journal for publishing the latest developments in telecommunications