基于深度强化学习的低地球轨道卫星增强移动边缘计算框架高效任务卸载

IF 1.4 4区 工程技术 Q4 ENGINEERING, ELECTRICAL & ELECTRONIC
Erlong Wei, Yihong Wen, Xuebo Liu
{"title":"基于深度强化学习的低地球轨道卫星增强移动边缘计算框架高效任务卸载","authors":"Erlong Wei,&nbsp;Yihong Wen,&nbsp;Xuebo Liu","doi":"10.1049/sil2/9674618","DOIUrl":null,"url":null,"abstract":"<p>With the rapid advancement of the Internet of Things (IoTs) and 6G technologies, traditional terrestrial networks are becoming less capable of supporting demanding computational tasks. This limitation stems from their restricted coverage and poor adaptability to changing environmental conditions. Low earth orbit (LEO) satellite networks offer global coverage. However, existing mobile edge computing (MEC) frameworks struggle with unstable links, high decision complexity, and limited real-time performance. To overcome these challenges, this paper proposes a LEO satellite-enhanced MEC off-loading architecture based on improved multiagent deep reinforcement learning (MADRL). By integrating ground terminals, LEO satellite edge servers, cloud servers into a three-tier collaborative system, and introducing an independent <i>Q</i>-value mechanism, the proposed method jointly optimizes task off-loading and resource allocation in dynamic environments. This design reduces algorithm complexity and enhances decision flexibility. Experimental results show that the proposed method outperforms baseline approaches in end-to-end latency, energy efficiency, and convergence speed, while maintaining robust performance under varying satellite densities and user workloads. These results demonstrate the potential of the proposed approach for efficient task off-loading in dynamic 6G scenarios.</p>","PeriodicalId":56301,"journal":{"name":"IET Signal Processing","volume":"2025 1","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2025-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/sil2/9674618","citationCount":"0","resultStr":"{\"title\":\"A Deep Reinforcement Learning–Based Low Earth Orbit Satellite-Enhanced Mobile Edge Computing Framework for Efficient Task Off-Loading\",\"authors\":\"Erlong Wei,&nbsp;Yihong Wen,&nbsp;Xuebo Liu\",\"doi\":\"10.1049/sil2/9674618\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>With the rapid advancement of the Internet of Things (IoTs) and 6G technologies, traditional terrestrial networks are becoming less capable of supporting demanding computational tasks. This limitation stems from their restricted coverage and poor adaptability to changing environmental conditions. Low earth orbit (LEO) satellite networks offer global coverage. However, existing mobile edge computing (MEC) frameworks struggle with unstable links, high decision complexity, and limited real-time performance. To overcome these challenges, this paper proposes a LEO satellite-enhanced MEC off-loading architecture based on improved multiagent deep reinforcement learning (MADRL). By integrating ground terminals, LEO satellite edge servers, cloud servers into a three-tier collaborative system, and introducing an independent <i>Q</i>-value mechanism, the proposed method jointly optimizes task off-loading and resource allocation in dynamic environments. This design reduces algorithm complexity and enhances decision flexibility. Experimental results show that the proposed method outperforms baseline approaches in end-to-end latency, energy efficiency, and convergence speed, while maintaining robust performance under varying satellite densities and user workloads. These results demonstrate the potential of the proposed approach for efficient task off-loading in dynamic 6G scenarios.</p>\",\"PeriodicalId\":56301,\"journal\":{\"name\":\"IET Signal Processing\",\"volume\":\"2025 1\",\"pages\":\"\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2025-09-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/sil2/9674618\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sil2/9674618\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://ietresearch.onlinelibrary.wiley.com/doi/10.1049/sil2/9674618","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

随着物联网(iot)和6G技术的快速发展,传统的地面网络越来越无法支持要求苛刻的计算任务。这种限制源于它们的覆盖范围有限,对不断变化的环境条件的适应能力差。低地球轨道(LEO)卫星网络提供全球覆盖。然而,现有的移动边缘计算(MEC)框架与不稳定的链路、高决策复杂性和有限的实时性能作斗争。为了克服这些挑战,本文提出了一种基于改进多智能体深度强化学习(MADRL)的LEO卫星增强MEC卸载架构。该方法通过将地面终端、LEO卫星边缘服务器、云服务器集成为三层协同系统,引入独立q值机制,共同优化动态环境下的任务卸载和资源分配。该设计降低了算法复杂度,提高了决策灵活性。实验结果表明,该方法在端到端延迟、能量效率和收敛速度方面优于基线方法,同时在不同卫星密度和用户工作负载下保持稳健的性能。这些结果证明了所提出的方法在动态6G场景中高效任务卸载的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

A Deep Reinforcement Learning–Based Low Earth Orbit Satellite-Enhanced Mobile Edge Computing Framework for Efficient Task Off-Loading

A Deep Reinforcement Learning–Based Low Earth Orbit Satellite-Enhanced Mobile Edge Computing Framework for Efficient Task Off-Loading

A Deep Reinforcement Learning–Based Low Earth Orbit Satellite-Enhanced Mobile Edge Computing Framework for Efficient Task Off-Loading

A Deep Reinforcement Learning–Based Low Earth Orbit Satellite-Enhanced Mobile Edge Computing Framework for Efficient Task Off-Loading

A Deep Reinforcement Learning–Based Low Earth Orbit Satellite-Enhanced Mobile Edge Computing Framework for Efficient Task Off-Loading

With the rapid advancement of the Internet of Things (IoTs) and 6G technologies, traditional terrestrial networks are becoming less capable of supporting demanding computational tasks. This limitation stems from their restricted coverage and poor adaptability to changing environmental conditions. Low earth orbit (LEO) satellite networks offer global coverage. However, existing mobile edge computing (MEC) frameworks struggle with unstable links, high decision complexity, and limited real-time performance. To overcome these challenges, this paper proposes a LEO satellite-enhanced MEC off-loading architecture based on improved multiagent deep reinforcement learning (MADRL). By integrating ground terminals, LEO satellite edge servers, cloud servers into a three-tier collaborative system, and introducing an independent Q-value mechanism, the proposed method jointly optimizes task off-loading and resource allocation in dynamic environments. This design reduces algorithm complexity and enhances decision flexibility. Experimental results show that the proposed method outperforms baseline approaches in end-to-end latency, energy efficiency, and convergence speed, while maintaining robust performance under varying satellite densities and user workloads. These results demonstrate the potential of the proposed approach for efficient task off-loading in dynamic 6G scenarios.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Signal Processing
IET Signal Processing 工程技术-工程:电子与电气
CiteScore
3.80
自引率
5.90%
发文量
83
审稿时长
9.5 months
期刊介绍: IET Signal Processing publishes research on a diverse range of signal processing and machine learning topics, covering a variety of applications, disciplines, modalities, and techniques in detection, estimation, inference, and classification problems. The research published includes advances in algorithm design for the analysis of single and high-multi-dimensional data, sparsity, linear and non-linear systems, recursive and non-recursive digital filters and multi-rate filter banks, as well a range of topics that span from sensor array processing, deep convolutional neural network based approaches to the application of chaos theory, and far more. Topics covered by scope include, but are not limited to: advances in single and multi-dimensional filter design and implementation linear and nonlinear, fixed and adaptive digital filters and multirate filter banks statistical signal processing techniques and analysis classical, parametric and higher order spectral analysis signal transformation and compression techniques, including time-frequency analysis system modelling and adaptive identification techniques machine learning based approaches to signal processing Bayesian methods for signal processing, including Monte-Carlo Markov-chain and particle filtering techniques theory and application of blind and semi-blind signal separation techniques signal processing techniques for analysis, enhancement, coding, synthesis and recognition of speech signals direction-finding and beamforming techniques for audio and electromagnetic signals analysis techniques for biomedical signals baseband signal processing techniques for transmission and reception of communication signals signal processing techniques for data hiding and audio watermarking sparse signal processing and compressive sensing Special Issue Call for Papers: Intelligent Deep Fuzzy Model for Signal Processing - https://digital-library.theiet.org/files/IET_SPR_CFP_IDFMSP.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信