面向物联网边缘智能的车载计算能力网络:基于ma - ddpg的鲁棒任务卸载和资源分配

IF 8.9 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Yi Liu;Li Jiang;Chau Yuen;Yan Zhang
{"title":"面向物联网边缘智能的车载计算能力网络:基于ma - ddpg的鲁棒任务卸载和资源分配","authors":"Yi Liu;Li Jiang;Chau Yuen;Yan Zhang","doi":"10.1109/JIOT.2025.3580736","DOIUrl":null,"url":null,"abstract":"The deep integration of Internet of Things (IoT) and vehicular networks demands ultrareliable, low-latency computing paradigms to support emerging applications like autonomous driving and smart traffic management. Existing mobile-edge computing (MEC) frameworks, however, struggle with dynamic resource heterogeneity, intermittent connectivity, and inefficient coordination among distributed nodes. To address these challenges, this article proposes vehicular computing power networks (VCPNs), an IoT-driven edge intelligence framework that orchestrates computational resources from mobile user equipments (MUEs), connected vehicles, and edge servers. We formulate a joint optimization problem to minimize end-to-end task latency by finding optimal task offloading decisions and resource allocation (e.g., CPU and bandwidth) policies under time-varying IoT channel conditions and node mobility. To enable decentralized coordination in IoT environment, we model the problem as a multiagent Markov decision process (MDP) and propose a multiagent deep deterministic policy gradient (MA-DDPG) algorithm in which agents (MUEs, vehicles, servers) collaboratively learn policies to optimize task scheduling and resource sharing. Furthermore, we design a robust MA-DDPG variant with error-resilient experience replay and channel-adaptive reward mechanisms to ensure reliable training under packet loss and unstable connectivity. Numerical results demonstrate that VCPN reduces average task latency and improves energy efficiency compared to federated MEC baselines. The proposed MA-DDPG algorithm achieves convergence stability in high-mobility scenarios, outperforming conventional deep reinforcement learning methods.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 18","pages":"36868-36879"},"PeriodicalIF":8.9000,"publicationDate":"2025-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Vehicular Computing Power Networks for IoT-Driven Edge Intelligence: MA-DDPG-Based Robust Task Offloading and Resource Allocation\",\"authors\":\"Yi Liu;Li Jiang;Chau Yuen;Yan Zhang\",\"doi\":\"10.1109/JIOT.2025.3580736\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The deep integration of Internet of Things (IoT) and vehicular networks demands ultrareliable, low-latency computing paradigms to support emerging applications like autonomous driving and smart traffic management. Existing mobile-edge computing (MEC) frameworks, however, struggle with dynamic resource heterogeneity, intermittent connectivity, and inefficient coordination among distributed nodes. To address these challenges, this article proposes vehicular computing power networks (VCPNs), an IoT-driven edge intelligence framework that orchestrates computational resources from mobile user equipments (MUEs), connected vehicles, and edge servers. We formulate a joint optimization problem to minimize end-to-end task latency by finding optimal task offloading decisions and resource allocation (e.g., CPU and bandwidth) policies under time-varying IoT channel conditions and node mobility. To enable decentralized coordination in IoT environment, we model the problem as a multiagent Markov decision process (MDP) and propose a multiagent deep deterministic policy gradient (MA-DDPG) algorithm in which agents (MUEs, vehicles, servers) collaboratively learn policies to optimize task scheduling and resource sharing. Furthermore, we design a robust MA-DDPG variant with error-resilient experience replay and channel-adaptive reward mechanisms to ensure reliable training under packet loss and unstable connectivity. Numerical results demonstrate that VCPN reduces average task latency and improves energy efficiency compared to federated MEC baselines. The proposed MA-DDPG algorithm achieves convergence stability in high-mobility scenarios, outperforming conventional deep reinforcement learning methods.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 18\",\"pages\":\"36868-36879\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2025-06-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11039641/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11039641/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

物联网(IoT)与车载网络的深度融合需要超可靠、低延迟的计算范式,以支持自动驾驶和智能交通管理等新兴应用。然而,现有的移动边缘计算(MEC)框架与动态资源异构、间歇性连接和分布式节点之间的低效协调作斗争。为了应对这些挑战,本文提出了车载计算能力网络(vcpn),这是一种物联网驱动的边缘智能框架,可以协调来自移动用户设备(mue)、联网车辆和边缘服务器的计算资源。我们制定了一个联合优化问题,通过在时变的物联网通道条件和节点移动性下找到最优的任务卸载决策和资源分配(例如CPU和带宽)策略来最小化端到端任务延迟。为了实现物联网环境下的分散协调,我们将问题建模为多智能体马尔可夫决策过程(MDP),并提出了一种多智能体深度确定性策略梯度(MA-DDPG)算法,其中智能体(mu,车辆,服务器)协同学习策略以优化任务调度和资源共享。此外,我们设计了一个鲁棒的MA-DDPG变体,具有错误弹性经验重播和信道自适应奖励机制,以确保在丢包和不稳定连接下的可靠训练。数值结果表明,与联邦MEC基线相比,VCPN降低了平均任务延迟,提高了能源效率。提出的MA-DDPG算法在高迁移场景下实现了收敛稳定性,优于传统的深度强化学习方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Vehicular Computing Power Networks for IoT-Driven Edge Intelligence: MA-DDPG-Based Robust Task Offloading and Resource Allocation
The deep integration of Internet of Things (IoT) and vehicular networks demands ultrareliable, low-latency computing paradigms to support emerging applications like autonomous driving and smart traffic management. Existing mobile-edge computing (MEC) frameworks, however, struggle with dynamic resource heterogeneity, intermittent connectivity, and inefficient coordination among distributed nodes. To address these challenges, this article proposes vehicular computing power networks (VCPNs), an IoT-driven edge intelligence framework that orchestrates computational resources from mobile user equipments (MUEs), connected vehicles, and edge servers. We formulate a joint optimization problem to minimize end-to-end task latency by finding optimal task offloading decisions and resource allocation (e.g., CPU and bandwidth) policies under time-varying IoT channel conditions and node mobility. To enable decentralized coordination in IoT environment, we model the problem as a multiagent Markov decision process (MDP) and propose a multiagent deep deterministic policy gradient (MA-DDPG) algorithm in which agents (MUEs, vehicles, servers) collaboratively learn policies to optimize task scheduling and resource sharing. Furthermore, we design a robust MA-DDPG variant with error-resilient experience replay and channel-adaptive reward mechanisms to ensure reliable training under packet loss and unstable connectivity. Numerical results demonstrate that VCPN reduces average task latency and improves energy efficiency compared to federated MEC baselines. The proposed MA-DDPG algorithm achieves convergence stability in high-mobility scenarios, outperforming conventional deep reinforcement learning methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Internet of Things Journal
IEEE Internet of Things Journal Computer Science-Information Systems
CiteScore
17.60
自引率
13.20%
发文量
1982
期刊介绍: The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信