移动设备低照度视频分析的自适应卸载和增强

Yuanyi He, Peng Yang, Tian Qin, Jiawei Hou, Ning Zhang
{"title":"移动设备低照度视频分析的自适应卸载和增强","authors":"Yuanyi He, Peng Yang, Tian Qin, Jiawei Hou, Ning Zhang","doi":"arxiv-2409.05297","DOIUrl":null,"url":null,"abstract":"In this paper, we explore adaptive offloading and enhancement strategies for\nvideo analytics tasks on computing-constrained mobile devices in low-light\nconditions. We observe that the accuracy of low-light video analytics varies\nfrom different enhancement algorithms. The root cause could be the disparities\nin the effectiveness of enhancement algorithms for feature extraction in\nanalytic models. Specifically, the difference in class activation maps (CAMs)\nbetween enhanced and low-light frames demonstrates a positive correlation with\nvideo analytics accuracy. Motivated by such observations, a novel enhancement\nquality assessment method is proposed on CAMs to evaluate the effectiveness of\ndifferent enhancement algorithms for low-light videos. Then, we design a\nmulti-edge system, which adaptively offloads and enhances low-light video\nanalytics tasks from mobile devices. To achieve the trade-off between the\nenhancement quality and the latency for all system-served mobile devices, we\npropose a genetic-based scheduling algorithm, which can find a near-optimal\nsolution in a reasonable time to meet the latency requirement. Thereby, the\noffloading strategies and the enhancement algorithms are properly selected\nunder the condition of limited end-edge bandwidth and edge computation\nresources. Simulation experiments demonstrate the superiority of the proposed\nsystem, improving accuracy up to 20.83\\% compared to existing benchmarks.","PeriodicalId":501480,"journal":{"name":"arXiv - CS - Multimedia","volume":"75 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Adaptive Offloading and Enhancement for Low-Light Video Analytics on Mobile Devices\",\"authors\":\"Yuanyi He, Peng Yang, Tian Qin, Jiawei Hou, Ning Zhang\",\"doi\":\"arxiv-2409.05297\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we explore adaptive offloading and enhancement strategies for\\nvideo analytics tasks on computing-constrained mobile devices in low-light\\nconditions. We observe that the accuracy of low-light video analytics varies\\nfrom different enhancement algorithms. The root cause could be the disparities\\nin the effectiveness of enhancement algorithms for feature extraction in\\nanalytic models. Specifically, the difference in class activation maps (CAMs)\\nbetween enhanced and low-light frames demonstrates a positive correlation with\\nvideo analytics accuracy. Motivated by such observations, a novel enhancement\\nquality assessment method is proposed on CAMs to evaluate the effectiveness of\\ndifferent enhancement algorithms for low-light videos. Then, we design a\\nmulti-edge system, which adaptively offloads and enhances low-light video\\nanalytics tasks from mobile devices. To achieve the trade-off between the\\nenhancement quality and the latency for all system-served mobile devices, we\\npropose a genetic-based scheduling algorithm, which can find a near-optimal\\nsolution in a reasonable time to meet the latency requirement. Thereby, the\\noffloading strategies and the enhancement algorithms are properly selected\\nunder the condition of limited end-edge bandwidth and edge computation\\nresources. Simulation experiments demonstrate the superiority of the proposed\\nsystem, improving accuracy up to 20.83\\\\% compared to existing benchmarks.\",\"PeriodicalId\":501480,\"journal\":{\"name\":\"arXiv - CS - Multimedia\",\"volume\":\"75 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Multimedia\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.05297\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Multimedia","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.05297","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在本文中,我们探讨了在低照度条件下,计算受限的移动设备上视频分析任务的自适应卸载和增强策略。我们发现,不同增强算法的低照度视频分析准确性各不相同。根本原因可能是增强算法对分析模型中特征提取的有效性存在差异。具体来说,增强帧和低照度帧之间的类激活图(CAM)差异与视频分析的准确性呈正相关。受这些观察结果的启发,我们提出了一种基于类激活图的新型增强质量评估方法,以评估不同增强算法在低照度视频中的有效性。然后,我们设计了一个多边缘系统,可以自适应地卸载和增强移动设备的弱光视频分析任务。为了实现所有系统服务的移动设备的增强质量和延迟之间的权衡,我们提出了一种基于遗传的调度算法,它能在合理的时间内找到接近最优的解决方案,以满足延迟要求。因此,在终端边缘带宽和边缘计算资源有限的条件下,可以适当选择卸载策略和增强算法。仿真实验证明了所提系统的优越性,与现有基准相比,准确率提高了20.83%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Adaptive Offloading and Enhancement for Low-Light Video Analytics on Mobile Devices
In this paper, we explore adaptive offloading and enhancement strategies for video analytics tasks on computing-constrained mobile devices in low-light conditions. We observe that the accuracy of low-light video analytics varies from different enhancement algorithms. The root cause could be the disparities in the effectiveness of enhancement algorithms for feature extraction in analytic models. Specifically, the difference in class activation maps (CAMs) between enhanced and low-light frames demonstrates a positive correlation with video analytics accuracy. Motivated by such observations, a novel enhancement quality assessment method is proposed on CAMs to evaluate the effectiveness of different enhancement algorithms for low-light videos. Then, we design a multi-edge system, which adaptively offloads and enhances low-light video analytics tasks from mobile devices. To achieve the trade-off between the enhancement quality and the latency for all system-served mobile devices, we propose a genetic-based scheduling algorithm, which can find a near-optimal solution in a reasonable time to meet the latency requirement. Thereby, the offloading strategies and the enhancement algorithms are properly selected under the condition of limited end-edge bandwidth and edge computation resources. Simulation experiments demonstrate the superiority of the proposed system, improving accuracy up to 20.83\% compared to existing benchmarks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信