基于最小生成树初始化和可转移强化学习策略的风险感知路由优化

IF 4.8 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
İhsan Ömür Bucak
{"title":"基于最小生成树初始化和可转移强化学习策略的风险感知路由优化","authors":"İhsan Ömür Bucak","doi":"10.1155/int/6250567","DOIUrl":null,"url":null,"abstract":"<p>Efficient route planning is a central challenge in applications such as autonomous area monitoring, infrastructure inspection, and logistics, where an agent must visit a set of locations while accounting not only for travel distance but also for spatially varying traversal risk. Classical distance-only optimizers minimize path length but are blind to such nongeometric costs. We propose a hybrid framework that integrates minimum spanning tree (MST)–based initialization with a transferable reinforcement-learning (RL) refinement policy for risk-aware routing. The MST provides a structured, low-cost initial tour; the RL agent then refines it under a multicriteria cost that combines distance and risk exposure. The key design choice is that the policy’s action-value function is linear in instance-independent, size-normalized features of a candidate edge exchange. As a result, a single 10-parameter weight vector is trained once and deployed on unseen instances and unseen problem sizes without any per-instance retraining. Across instances of 15–100 nodes (30 independent instances per size; 12 at <i>n</i> = 100), the proposed MST–RL method reduces multicriteria cost by 16%–27% over the MST baseline (<i>p</i> &lt; 10<sup>−3</sup> at every size) and decisively outperforms a randomly initialized RL policy (up to 44% at <i>n</i> = 100, <i>p</i> &lt; 10<sup>−3</sup>), confirming the value of MST initialization. It attains cost competitive with, though not superior to, exhaustive local search and ant colony optimization while running 24–126 × faster per instance at <i>n</i> = 100, with inference time that does not grow with problem size. A reward-weight sweep demonstrates controllable distance–risk trade-offs. These properties make the method attractive for on-board, real-time deployment on resource-constrained hardware.</p>","PeriodicalId":14089,"journal":{"name":"International Journal of Intelligent Systems","volume":"2026 1","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2026-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1155/int/6250567","citationCount":"0","resultStr":"{\"title\":\"Risk-Aware Route Optimization Using Minimum Spanning Tree Initialization and a Transferable Reinforcement Learning Policy\",\"authors\":\"İhsan Ömür Bucak\",\"doi\":\"10.1155/int/6250567\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Efficient route planning is a central challenge in applications such as autonomous area monitoring, infrastructure inspection, and logistics, where an agent must visit a set of locations while accounting not only for travel distance but also for spatially varying traversal risk. Classical distance-only optimizers minimize path length but are blind to such nongeometric costs. We propose a hybrid framework that integrates minimum spanning tree (MST)–based initialization with a transferable reinforcement-learning (RL) refinement policy for risk-aware routing. The MST provides a structured, low-cost initial tour; the RL agent then refines it under a multicriteria cost that combines distance and risk exposure. The key design choice is that the policy’s action-value function is linear in instance-independent, size-normalized features of a candidate edge exchange. As a result, a single 10-parameter weight vector is trained once and deployed on unseen instances and unseen problem sizes without any per-instance retraining. Across instances of 15–100 nodes (30 independent instances per size; 12 at <i>n</i> = 100), the proposed MST–RL method reduces multicriteria cost by 16%–27% over the MST baseline (<i>p</i> &lt; 10<sup>−3</sup> at every size) and decisively outperforms a randomly initialized RL policy (up to 44% at <i>n</i> = 100, <i>p</i> &lt; 10<sup>−3</sup>), confirming the value of MST initialization. It attains cost competitive with, though not superior to, exhaustive local search and ant colony optimization while running 24–126 × faster per instance at <i>n</i> = 100, with inference time that does not grow with problem size. A reward-weight sweep demonstrates controllable distance–risk trade-offs. These properties make the method attractive for on-board, real-time deployment on resource-constrained hardware.</p>\",\"PeriodicalId\":14089,\"journal\":{\"name\":\"International Journal of Intelligent Systems\",\"volume\":\"2026 1\",\"pages\":\"\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2026-09-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1155/int/6250567\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Intelligent Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1155/int/6250567\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1155/int/6250567","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

在自治区域监控、基础设施检查和物流等应用中,高效的路线规划是一个核心挑战,在这些应用中,agent必须访问一组地点,同时不仅要考虑旅行距离,还要考虑空间变化的穿越风险。经典的只考虑距离的优化器可以最小化路径长度,但对这种非几何代价视而不见。我们提出了一个混合框架,将基于最小生成树(MST)的初始化与可转移的强化学习(RL)改进策略集成在一起,用于风险感知路由。MST提供有组织的、低成本的初始旅行;然后,RL代理根据结合距离和风险暴露的多标准成本对其进行改进。关键的设计选择是策略的动作值函数在候选边缘交换的实例无关的、大小标准化的特征中是线性的。因此,单个10个参数的权重向量只训练一次,并部署在不可见的实例和不可见的问题大小上,而无需对每个实例进行重新训练。在15-100个节点的实例(每个大小30个独立实例;n = 100时12个)中,所提出的MST - RL方法比MST基线(每种大小p <; 10−3)降低了16%-27%的多标准成本,并且明显优于随机初始化的RL策略(在n = 100时高达44%,p < 10−3),确认了MST初始化的价值。它在成本上与穷举局部搜索和蚁群优化具有竞争力,但并不优于它们,而在n = 100时,每个实例的运行速度要快24-126倍,推理时间不会随着问题规模的增长而增长。奖励-权重扫描显示了可控的距离-风险权衡。这些特性使得该方法非常适合在资源受限的硬件上进行实时部署。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Risk-Aware Route Optimization Using Minimum Spanning Tree Initialization and a Transferable Reinforcement Learning Policy

Efficient route planning is a central challenge in applications such as autonomous area monitoring, infrastructure inspection, and logistics, where an agent must visit a set of locations while accounting not only for travel distance but also for spatially varying traversal risk. Classical distance-only optimizers minimize path length but are blind to such nongeometric costs. We propose a hybrid framework that integrates minimum spanning tree (MST)–based initialization with a transferable reinforcement-learning (RL) refinement policy for risk-aware routing. The MST provides a structured, low-cost initial tour; the RL agent then refines it under a multicriteria cost that combines distance and risk exposure. The key design choice is that the policy’s action-value function is linear in instance-independent, size-normalized features of a candidate edge exchange. As a result, a single 10-parameter weight vector is trained once and deployed on unseen instances and unseen problem sizes without any per-instance retraining. Across instances of 15–100 nodes (30 independent instances per size; 12 at n = 100), the proposed MST–RL method reduces multicriteria cost by 16%–27% over the MST baseline (p < 10−3 at every size) and decisively outperforms a randomly initialized RL policy (up to 44% at n = 100, p < 10−3), confirming the value of MST initialization. It attains cost competitive with, though not superior to, exhaustive local search and ant colony optimization while running 24–126 × faster per instance at n = 100, with inference time that does not grow with problem size. A reward-weight sweep demonstrates controllable distance–risk trade-offs. These properties make the method attractive for on-board, real-time deployment on resource-constrained hardware.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International Journal of Intelligent Systems
International Journal of Intelligent Systems 工程技术-计算机:人工智能
CiteScore
11.30
自引率
14.30%
发文量
304
审稿时长
9 months
期刊介绍: The International Journal of Intelligent Systems serves as a forum for individuals interested in tapping into the vast theories based on intelligent systems construction. With its peer-reviewed format, the journal explores several fascinating editorials written by today''s experts in the field. Because new developments are being introduced each day, there''s much to be learned — examination, analysis creation, information retrieval, man–computer interactions, and more. The International Journal of Intelligent Systems uses charts and illustrations to demonstrate these ground-breaking issues, and encourages readers to share their thoughts and experiences.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书