基于深度强化学习的无人机电力巡检任务卸载策略

Tong Jin, Gu Minghao, Sha Yun, Deng Fang-ming
{"title":"基于深度强化学习的无人机电力巡检任务卸载策略","authors":"Tong Jin, Gu Minghao, Sha Yun, Deng Fang-ming","doi":"10.1117/12.2671522","DOIUrl":null,"url":null,"abstract":"Due to the limitation of computer capacity and energy of equipment, unmanned equipment cannot perform intensive computer tasks well during emergency failure inspection. In order to solve the above problems, this paper proposes a task waste strategy based on Deep Reinforcement Learning (DRL), which is mainly applicable to several UAVs and individual ES scenarios. First of all, an end edge cloud cooperative unloading architecture is built in the edge environment of UAV, and the problem of unloading tasks is classified as an optimization problem to achieve the minimum delay under the limit of the computing and communication resources of the Edge Server (ES). Secondly, the problem is constructed as Markov decision, and Deep Q Network (DQN) is used to solve the optimization problem, and experience playback mechanism and greedy algorithm are introduced into the learning process. Experiments show that the mitigation strategy has lower latency and higher reliability.","PeriodicalId":227528,"journal":{"name":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-04-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Offloading strategy for UAV power inspection task based on deep reinforcement learning\",\"authors\":\"Tong Jin, Gu Minghao, Sha Yun, Deng Fang-ming\",\"doi\":\"10.1117/12.2671522\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Due to the limitation of computer capacity and energy of equipment, unmanned equipment cannot perform intensive computer tasks well during emergency failure inspection. In order to solve the above problems, this paper proposes a task waste strategy based on Deep Reinforcement Learning (DRL), which is mainly applicable to several UAVs and individual ES scenarios. First of all, an end edge cloud cooperative unloading architecture is built in the edge environment of UAV, and the problem of unloading tasks is classified as an optimization problem to achieve the minimum delay under the limit of the computing and communication resources of the Edge Server (ES). Secondly, the problem is constructed as Markov decision, and Deep Q Network (DQN) is used to solve the optimization problem, and experience playback mechanism and greedy algorithm are introduced into the learning process. Experiments show that the mitigation strategy has lower latency and higher reliability.\",\"PeriodicalId\":227528,\"journal\":{\"name\":\"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2671522\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2671522","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

由于设备计算机容量和能量的限制,在紧急故障检测中,无人设备不能很好地完成密集的计算机任务。为了解决上述问题,本文提出了一种基于深度强化学习(Deep Reinforcement Learning, DRL)的任务浪费策略,该策略主要适用于多个无人机和单个ES场景。首先,在无人机边缘环境中构建了端边缘云协同卸载架构,并将任务卸载问题归类为在边缘服务器(ES)计算和通信资源限制下实现最小延迟的优化问题。其次,将问题构造为马尔可夫决策,利用深度Q网络(Deep Q Network, DQN)求解优化问题,并在学习过程中引入经验回放机制和贪心算法;实验表明,该缓解策略具有较低的时延和较高的可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Offloading strategy for UAV power inspection task based on deep reinforcement learning
Due to the limitation of computer capacity and energy of equipment, unmanned equipment cannot perform intensive computer tasks well during emergency failure inspection. In order to solve the above problems, this paper proposes a task waste strategy based on Deep Reinforcement Learning (DRL), which is mainly applicable to several UAVs and individual ES scenarios. First of all, an end edge cloud cooperative unloading architecture is built in the edge environment of UAV, and the problem of unloading tasks is classified as an optimization problem to achieve the minimum delay under the limit of the computing and communication resources of the Edge Server (ES). Secondly, the problem is constructed as Markov decision, and Deep Q Network (DQN) is used to solve the optimization problem, and experience playback mechanism and greedy algorithm are introduced into the learning process. Experiments show that the mitigation strategy has lower latency and higher reliability.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信