基于深度强化学习和纳什均衡博弈的车联网任务卸载优化策略

IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Chao He;Wenhui Jiang;Xing Wang;Wanting Wang;Jiacheng Wang;Xin Xie
{"title":"基于深度强化学习和纳什均衡博弈的车联网任务卸载优化策略","authors":"Chao He;Wenhui Jiang;Xing Wang;Wanting Wang;Jiacheng Wang;Xin Xie","doi":"10.1109/JSEN.2025.3558228","DOIUrl":null,"url":null,"abstract":"With the rapid development of 5G, the amount of data generated by the Internet of Vehicles (IoVs) is growing explosively, which affects the efficiency of vehicle task offloading. To solve this problem, this article proposes a task offloading strategy based on regional roadside unit fusion (RRF) algorithm. First, with the help of sensors to collect vehicle historical trajectory data as input, the deep reinforcement learning (DRL) technique combined with convolutional neural network (CNN) and path planning algorithm is used to accurately project the dynamic behavior of vehicles. Second, when a roadside unit fusion (RSU) is unable to handle a task, the automatic tagging (AT) algorithm will tag the RSU, preparing for the optimization of subsequent RSU. Finally, the Nash equilibrium game (NEG) algorithm is used to optimize RSU resource allocation to maximize task offloading efficiency and reduce energy consumption. Experimental results show that the RRF algorithm proposed in this article has significant advantages over the standard Full DRL algorithm and the nonorthogonal multiple access (NOMA) algorithm. In terms of task offloading delay, it reduces 11.2% and 9.6%, respectively, energy consumption is reduced by 12.7% and 8.2%, respectively, and the task offloading success rate is improved to 92%, which is significantly better than the comparison algorithms. The algorithm provides a better solution for the practical application of mobile edge computing (MEC) in the IoV.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 10","pages":"18384-18393"},"PeriodicalIF":4.3000,"publicationDate":"2025-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Reinforcement Learning and Nash Equilibrium Game-Based Task Offloading Optimization Strategy for the IoV\",\"authors\":\"Chao He;Wenhui Jiang;Xing Wang;Wanting Wang;Jiacheng Wang;Xin Xie\",\"doi\":\"10.1109/JSEN.2025.3558228\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the rapid development of 5G, the amount of data generated by the Internet of Vehicles (IoVs) is growing explosively, which affects the efficiency of vehicle task offloading. To solve this problem, this article proposes a task offloading strategy based on regional roadside unit fusion (RRF) algorithm. First, with the help of sensors to collect vehicle historical trajectory data as input, the deep reinforcement learning (DRL) technique combined with convolutional neural network (CNN) and path planning algorithm is used to accurately project the dynamic behavior of vehicles. Second, when a roadside unit fusion (RSU) is unable to handle a task, the automatic tagging (AT) algorithm will tag the RSU, preparing for the optimization of subsequent RSU. Finally, the Nash equilibrium game (NEG) algorithm is used to optimize RSU resource allocation to maximize task offloading efficiency and reduce energy consumption. Experimental results show that the RRF algorithm proposed in this article has significant advantages over the standard Full DRL algorithm and the nonorthogonal multiple access (NOMA) algorithm. In terms of task offloading delay, it reduces 11.2% and 9.6%, respectively, energy consumption is reduced by 12.7% and 8.2%, respectively, and the task offloading success rate is improved to 92%, which is significantly better than the comparison algorithms. The algorithm provides a better solution for the practical application of mobile edge computing (MEC) in the IoV.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 10\",\"pages\":\"18384-18393\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-04-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10964011/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10964011/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

随着5G的快速发展,车联网产生的数据量呈爆炸式增长,影响了车辆任务卸载的效率。针对这一问题,本文提出了一种基于区域路边单元融合(RRF)算法的任务卸载策略。首先,借助传感器采集车辆历史轨迹数据作为输入,结合卷积神经网络(CNN)和路径规划算法,采用深度强化学习(DRL)技术对车辆的动态行为进行精确投影;其次,当路边单元融合(RSU)无法处理任务时,自动标记(AT)算法将标记该RSU,为后续RSU的优化做准备。最后,采用纳什均衡博弈(NEG)算法对RSU资源进行优化分配,使任务卸载效率最大化,降低能耗。实验结果表明,本文提出的RRF算法相对于标准的Full DRL算法和非正交多址(NOMA)算法具有显著的优势。在任务卸载延迟方面,分别降低11.2%和9.6%,能耗分别降低12.7%和8.2%,任务卸载成功率提高到92%,明显优于对比算法。该算法为移动边缘计算在车联网中的实际应用提供了较好的解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Deep Reinforcement Learning and Nash Equilibrium Game-Based Task Offloading Optimization Strategy for the IoV
With the rapid development of 5G, the amount of data generated by the Internet of Vehicles (IoVs) is growing explosively, which affects the efficiency of vehicle task offloading. To solve this problem, this article proposes a task offloading strategy based on regional roadside unit fusion (RRF) algorithm. First, with the help of sensors to collect vehicle historical trajectory data as input, the deep reinforcement learning (DRL) technique combined with convolutional neural network (CNN) and path planning algorithm is used to accurately project the dynamic behavior of vehicles. Second, when a roadside unit fusion (RSU) is unable to handle a task, the automatic tagging (AT) algorithm will tag the RSU, preparing for the optimization of subsequent RSU. Finally, the Nash equilibrium game (NEG) algorithm is used to optimize RSU resource allocation to maximize task offloading efficiency and reduce energy consumption. Experimental results show that the RRF algorithm proposed in this article has significant advantages over the standard Full DRL algorithm and the nonorthogonal multiple access (NOMA) algorithm. In terms of task offloading delay, it reduces 11.2% and 9.6%, respectively, energy consumption is reduced by 12.7% and 8.2%, respectively, and the task offloading success rate is improved to 92%, which is significantly better than the comparison algorithms. The algorithm provides a better solution for the practical application of mobile edge computing (MEC) in the IoV.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信