基于整体事件触发机制的旋翼辅助车辆强化学习自主导航策略

IF 7.7 1区 工程技术 Q1 ENVIRONMENTAL STUDIES
Guoqing Zhang , Zhihao Li , Jiqiang Li , Yaqing Shu , Xianku Zhang
{"title":"基于整体事件触发机制的旋翼辅助车辆强化学习自主导航策略","authors":"Guoqing Zhang ,&nbsp;Zhihao Li ,&nbsp;Jiqiang Li ,&nbsp;Yaqing Shu ,&nbsp;Xianku Zhang","doi":"10.1016/j.trd.2025.104841","DOIUrl":null,"url":null,"abstract":"<div><div>To exploit wind resources for maritime decarbonization, this study proposes an autonomous navigation strategy driven by reinforcement learning (RL) for rotor-assisted vehicles (RAVs) equipped with rotor-sails—a pivotal wind-assisted propulsion technology. For achieving the optimal solution in each backstepping step, a concise and robust path following optimization algorithm using RL is designed in the form of actor-critic neural networks (AC-NNs), where the actor NNs generate control commands through real-time state feedback and the critic NNs perform state value assessment based on environmental information. Furthermore, an integral dynamic variable threshold event-triggered mechanism dependent on output state errors is proposed to avoid excessive actuator wear caused by frequent updates and transmission of control commands. Finally, theoretical validation and numerical experiments are illustrated to confirm the viability of the proposed RL-driven navigation strategy and its significant contribution to energy conservation in maritime transport.</div></div>","PeriodicalId":23277,"journal":{"name":"Transportation Research Part D-transport and Environment","volume":"146 ","pages":"Article 104841"},"PeriodicalIF":7.7000,"publicationDate":"2025-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Reinforcement learning-driven autonomous navigation strategy for rotor-assisted vehicles via integral event-triggered mechanism\",\"authors\":\"Guoqing Zhang ,&nbsp;Zhihao Li ,&nbsp;Jiqiang Li ,&nbsp;Yaqing Shu ,&nbsp;Xianku Zhang\",\"doi\":\"10.1016/j.trd.2025.104841\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>To exploit wind resources for maritime decarbonization, this study proposes an autonomous navigation strategy driven by reinforcement learning (RL) for rotor-assisted vehicles (RAVs) equipped with rotor-sails—a pivotal wind-assisted propulsion technology. For achieving the optimal solution in each backstepping step, a concise and robust path following optimization algorithm using RL is designed in the form of actor-critic neural networks (AC-NNs), where the actor NNs generate control commands through real-time state feedback and the critic NNs perform state value assessment based on environmental information. Furthermore, an integral dynamic variable threshold event-triggered mechanism dependent on output state errors is proposed to avoid excessive actuator wear caused by frequent updates and transmission of control commands. Finally, theoretical validation and numerical experiments are illustrated to confirm the viability of the proposed RL-driven navigation strategy and its significant contribution to energy conservation in maritime transport.</div></div>\",\"PeriodicalId\":23277,\"journal\":{\"name\":\"Transportation Research Part D-transport and Environment\",\"volume\":\"146 \",\"pages\":\"Article 104841\"},\"PeriodicalIF\":7.7000,\"publicationDate\":\"2025-07-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Transportation Research Part D-transport and Environment\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1361920925002512\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENVIRONMENTAL STUDIES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transportation Research Part D-transport and Environment","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1361920925002512","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL STUDIES","Score":null,"Total":0}
引用次数: 0

摘要

为了利用风能资源进行海上脱碳,本研究提出了一种由强化学习(RL)驱动的自主导航策略,用于配备桨帆的旋翼辅助车辆(RAVs),这是一种关键的风辅助推进技术。为了在每个后退步骤中实现最优解,使用RL设计了一种简洁且鲁棒的路径跟踪优化算法,以行动者-评论家神经网络(ac - nn)的形式,其中行动者神经网络通过实时状态反馈生成控制命令,评论家神经网络根据环境信息执行状态值评估。此外,提出了一种依赖于输出状态误差的积分动态变阈值事件触发机制,以避免控制命令的频繁更新和传输造成致动器过度磨损。最后,通过理论验证和数值实验验证了rl驱动导航策略的可行性及其对海上运输节能的重要贡献。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Reinforcement learning-driven autonomous navigation strategy for rotor-assisted vehicles via integral event-triggered mechanism
To exploit wind resources for maritime decarbonization, this study proposes an autonomous navigation strategy driven by reinforcement learning (RL) for rotor-assisted vehicles (RAVs) equipped with rotor-sails—a pivotal wind-assisted propulsion technology. For achieving the optimal solution in each backstepping step, a concise and robust path following optimization algorithm using RL is designed in the form of actor-critic neural networks (AC-NNs), where the actor NNs generate control commands through real-time state feedback and the critic NNs perform state value assessment based on environmental information. Furthermore, an integral dynamic variable threshold event-triggered mechanism dependent on output state errors is proposed to avoid excessive actuator wear caused by frequent updates and transmission of control commands. Finally, theoretical validation and numerical experiments are illustrated to confirm the viability of the proposed RL-driven navigation strategy and its significant contribution to energy conservation in maritime transport.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
14.40
自引率
9.20%
发文量
314
审稿时长
39 days
期刊介绍: Transportation Research Part D: Transport and Environment focuses on original research exploring the environmental impacts of transportation, policy responses to these impacts, and their implications for transportation system design, planning, and management. The journal comprehensively covers the interaction between transportation and the environment, ranging from local effects on specific geographical areas to global implications such as natural resource depletion and atmospheric pollution. We welcome research papers across all transportation modes, including maritime, air, and land transportation, assessing their environmental impacts broadly. Papers addressing both mobile aspects and transportation infrastructure are considered. The journal prioritizes empirical findings and policy responses of regulatory, planning, technical, or fiscal nature. Articles are policy-driven, accessible, and applicable to readers from diverse disciplines, emphasizing relevance and practicality. We encourage interdisciplinary submissions and welcome contributions from economically developing and advanced countries alike, reflecting our international orientation.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信