无人机无线网络中目标检测驱动的联合视频传输与处理的信息价值优化

Nan Cheng;Haoran Chen;Ruijin Sun;Longfei Ma;Conghao Zhou;Yuan Zhang;Yilong Hui
{"title":"无人机无线网络中目标检测驱动的联合视频传输与处理的信息价值优化","authors":"Nan Cheng;Haoran Chen;Ruijin Sun;Longfei Ma;Conghao Zhou;Yuan Zhang;Yilong Hui","doi":"10.1109/JMASS.2025.3567087","DOIUrl":null,"url":null,"abstract":"In the wake of disasters, rapid and efficient search and rescue operations are essential. Uncrewed aerial vehicles (UAVs) have become instrumental in such scenarios, providing real-time video streaming that can be used for object detection to locate survivors. This technology, however, faces significant challenges due to the limited communication and onboard computational resources, which are critical for processing and transmitting high-quality video data. To address these issues, this article proposes a novel approach that leverages the concept of the value of information (VoI) to optimize the tradeoff between the accuracy of object detection and the associated communication costs. By dynamically adjusting the video stream’s quality, the proposed system aims to ensure that the most valuable information is transmitted within the constraints of bandwidth and computational power. To operationalize this concept, we introduce a deep reinforcement learning (DRL) algorithm that employs the soft actor-critic (SAC) method. The algorithm benefits from the integration of object features and contextual information extracted by ResNet50, which is then processed through a cross-attention structure within the critic network. Our simulation results indicate that our approach significantly enhances the VoI, achieving higher accuracy in object detection with better resource management compared to traditional strategies.","PeriodicalId":100624,"journal":{"name":"IEEE Journal on Miniaturization for Air and Space Systems","volume":"6 2","pages":"59-69"},"PeriodicalIF":0.0000,"publicationDate":"2025-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Value-of-Information Optimization for Object Detection-Driven Joint Video Transmission and Processing in UAV-Enabled Wireless Networks\",\"authors\":\"Nan Cheng;Haoran Chen;Ruijin Sun;Longfei Ma;Conghao Zhou;Yuan Zhang;Yilong Hui\",\"doi\":\"10.1109/JMASS.2025.3567087\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the wake of disasters, rapid and efficient search and rescue operations are essential. Uncrewed aerial vehicles (UAVs) have become instrumental in such scenarios, providing real-time video streaming that can be used for object detection to locate survivors. This technology, however, faces significant challenges due to the limited communication and onboard computational resources, which are critical for processing and transmitting high-quality video data. To address these issues, this article proposes a novel approach that leverages the concept of the value of information (VoI) to optimize the tradeoff between the accuracy of object detection and the associated communication costs. By dynamically adjusting the video stream’s quality, the proposed system aims to ensure that the most valuable information is transmitted within the constraints of bandwidth and computational power. To operationalize this concept, we introduce a deep reinforcement learning (DRL) algorithm that employs the soft actor-critic (SAC) method. The algorithm benefits from the integration of object features and contextual information extracted by ResNet50, which is then processed through a cross-attention structure within the critic network. Our simulation results indicate that our approach significantly enhances the VoI, achieving higher accuracy in object detection with better resource management compared to traditional strategies.\",\"PeriodicalId\":100624,\"journal\":{\"name\":\"IEEE Journal on Miniaturization for Air and Space Systems\",\"volume\":\"6 2\",\"pages\":\"59-69\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-03-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal on Miniaturization for Air and Space Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10988650/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal on Miniaturization for Air and Space Systems","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10988650/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

灾害发生后,快速有效的搜救行动至关重要。无人驾驶飞行器(uav)在这种情况下发挥了重要作用,提供实时视频流,可用于物体检测以定位幸存者。然而,由于通信和机载计算资源有限,该技术面临着重大挑战,这对于处理和传输高质量的视频数据至关重要。为了解决这些问题,本文提出了一种新的方法,利用信息价值(VoI)的概念来优化目标检测的准确性和相关的通信成本之间的权衡。该系统通过动态调整视频流的质量,确保在带宽和计算能力的限制下传输最有价值的信息。为了实现这一概念,我们引入了一种采用软行为者批评家(SAC)方法的深度强化学习(DRL)算法。该算法得益于ResNet50提取的对象特征和上下文信息的集成,然后通过评论家网络中的交叉注意结构对其进行处理。仿真结果表明,与传统策略相比,我们的方法显著提高了VoI,在更好的资源管理下实现了更高的目标检测精度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Value-of-Information Optimization for Object Detection-Driven Joint Video Transmission and Processing in UAV-Enabled Wireless Networks
In the wake of disasters, rapid and efficient search and rescue operations are essential. Uncrewed aerial vehicles (UAVs) have become instrumental in such scenarios, providing real-time video streaming that can be used for object detection to locate survivors. This technology, however, faces significant challenges due to the limited communication and onboard computational resources, which are critical for processing and transmitting high-quality video data. To address these issues, this article proposes a novel approach that leverages the concept of the value of information (VoI) to optimize the tradeoff between the accuracy of object detection and the associated communication costs. By dynamically adjusting the video stream’s quality, the proposed system aims to ensure that the most valuable information is transmitted within the constraints of bandwidth and computational power. To operationalize this concept, we introduce a deep reinforcement learning (DRL) algorithm that employs the soft actor-critic (SAC) method. The algorithm benefits from the integration of object features and contextual information extracted by ResNet50, which is then processed through a cross-attention structure within the critic network. Our simulation results indicate that our approach significantly enhances the VoI, achieving higher accuracy in object detection with better resource management compared to traditional strategies.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
4.40
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信