Goal-Conditioned Resource Allocation With Hierarchical Offloading and Reliable Consensus for Blockchain-Based Industrial Digital Twins

IF 7.9 2区 计算机科学 Q1 ENGINEERING, MULTIDISCIPLINARY
Kening Zhang;Carman K. M. Lee;Yung Po Tsang
{"title":"Goal-Conditioned Resource Allocation With Hierarchical Offloading and Reliable Consensus for Blockchain-Based Industrial Digital Twins","authors":"Kening Zhang;Carman K. M. Lee;Yung Po Tsang","doi":"10.1109/TNSE.2025.3565554","DOIUrl":null,"url":null,"abstract":"In the current technological landscape, digital twins (DTs) are critical enablers for enhancing communication efficiency, data processing and on-line monitoring with virtual copies in industry network environments. However, heterogeneous devices and sensitive data breaches intensify challenges in security and management. Rapidly changing business requirements further exacerbate these issues, as traditional algorithms struggle to adapt to dynamic industrial demands. Simultaneously, overloaded edge servers, ultra-reliable low latency communications (URLLC), and limited resources make real-time decision-making even more difficult. Hence, we propose a hierarchical offloading and resource allocation framework for blockchain-based industrial D2D DT (OR-BIDT), which addresses these challenges by providing offloading and allocation strategies that protect data privacy and reliable communication. Then, we propose an R-DPoS consensus mechanism that optimizes node selection by introducing a voting mechanism with transmission reliability and computation frequency to improve the security of block verification. For problems requiring optimization over a goal space rather than the simple linear weighted sum in OR-BIDT, we design a goal-conditioned reinforcement learning (GCRL) approach with locality sensitive hashing-based experience replay (LSHER) to accomplish efficient experience returns. Simulations show that the critical and actor networks of our proposed algorithm converge 71.43% and 14.29% faster than the benchmark method, respectively.","PeriodicalId":54229,"journal":{"name":"IEEE Transactions on Network Science and Engineering","volume":"12 5","pages":"3797-3811"},"PeriodicalIF":7.9000,"publicationDate":"2025-04-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Network Science and Engineering","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10980033/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

In the current technological landscape, digital twins (DTs) are critical enablers for enhancing communication efficiency, data processing and on-line monitoring with virtual copies in industry network environments. However, heterogeneous devices and sensitive data breaches intensify challenges in security and management. Rapidly changing business requirements further exacerbate these issues, as traditional algorithms struggle to adapt to dynamic industrial demands. Simultaneously, overloaded edge servers, ultra-reliable low latency communications (URLLC), and limited resources make real-time decision-making even more difficult. Hence, we propose a hierarchical offloading and resource allocation framework for blockchain-based industrial D2D DT (OR-BIDT), which addresses these challenges by providing offloading and allocation strategies that protect data privacy and reliable communication. Then, we propose an R-DPoS consensus mechanism that optimizes node selection by introducing a voting mechanism with transmission reliability and computation frequency to improve the security of block verification. For problems requiring optimization over a goal space rather than the simple linear weighted sum in OR-BIDT, we design a goal-conditioned reinforcement learning (GCRL) approach with locality sensitive hashing-based experience replay (LSHER) to accomplish efficient experience returns. Simulations show that the critical and actor networks of our proposed algorithm converge 71.43% and 14.29% faster than the benchmark method, respectively.
基于区块链的工业数字孪生的分层卸载和可靠共识的目标条件资源分配
在当前的技术环境中,数字孪生体(dt)是提高通信效率、数据处理和工业网络环境中虚拟副本在线监测的关键推动者。然而,异构设备和敏感数据泄露加剧了安全和管理方面的挑战。快速变化的业务需求进一步加剧了这些问题,因为传统算法难以适应动态的工业需求。同时,过载的边缘服务器、超可靠的低延迟通信(URLLC)和有限的资源使得实时决策更加困难。因此,我们提出了基于区块链的工业D2D DT (OR-BIDT)的分层卸载和资源分配框架,该框架通过提供保护数据隐私和可靠通信的卸载和分配策略来解决这些挑战。然后,我们提出了一种R-DPoS共识机制,该机制通过引入具有传输可靠性和计算频率的投票机制来优化节点选择,以提高区块验证的安全性。对于OR-BIDT中需要在目标空间而不是简单线性加权和上进行优化的问题,我们设计了一种基于局部敏感哈希的经验重播(LSHER)的目标条件强化学习(GCRL)方法来实现有效的经验返回。仿真结果表明,该算法的关键网络和参与者网络的收敛速度分别比基准方法快71.43%和14.29%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Transactions on Network Science and Engineering
IEEE Transactions on Network Science and Engineering Engineering-Control and Systems Engineering
CiteScore
12.60
自引率
9.10%
发文量
393
期刊介绍: The proposed journal, called the IEEE Transactions on Network Science and Engineering (TNSE), is committed to timely publishing of peer-reviewed technical articles that deal with the theory and applications of network science and the interconnections among the elements in a system that form a network. In particular, the IEEE Transactions on Network Science and Engineering publishes articles on understanding, prediction, and control of structures and behaviors of networks at the fundamental level. The types of networks covered include physical or engineered networks, information networks, biological networks, semantic networks, economic networks, social networks, and ecological networks. Aimed at discovering common principles that govern network structures, network functionalities and behaviors of networks, the journal seeks articles on understanding, prediction, and control of structures and behaviors of networks. Another trans-disciplinary focus of the IEEE Transactions on Network Science and Engineering is the interactions between and co-evolution of different genres of networks.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信