Scenario Adaptive Edge Data Reduction

Handuo Zhang, Jun Na, Bin Zhang
{"title":"Scenario Adaptive Edge Data Reduction","authors":"Handuo Zhang, Jun Na, Bin Zhang","doi":"10.1109/EDGE53862.2021.00011","DOIUrl":null,"url":null,"abstract":"It becomes common to deploy a pre-trained machine learning model on the edge devices to improve their intelligence. Considering the dynamic nature of the edge environment, for ensuring decision accuracy, edge devices always need to collect the latest samples and upload them to the cloud to get an updated model. During this process, it is crucial to determine which samples are necessary to be uploaded considering the communication cost. We propose a scenario adaptive edge data reduction strategy to filter samples differently from existing approaches by measuring whether they can affect current decision accuracy. First, we put forward a novel adaptive data reduction framework for cloud-edge collaborative scenarios. Then, we present the implementation algorithms for filtering samples based on scenarios, identifying candidate scenarios emerging in edge environments, and updating edge scenarios. Experiment results show that in the best case, our approach can discard 70% samples while keeping the same inference accuracy with the original sample set.","PeriodicalId":115969,"journal":{"name":"2021 IEEE International Conference on Edge Computing (EDGE)","volume":"19 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE International Conference on Edge Computing (EDGE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/EDGE53862.2021.00011","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

It becomes common to deploy a pre-trained machine learning model on the edge devices to improve their intelligence. Considering the dynamic nature of the edge environment, for ensuring decision accuracy, edge devices always need to collect the latest samples and upload them to the cloud to get an updated model. During this process, it is crucial to determine which samples are necessary to be uploaded considering the communication cost. We propose a scenario adaptive edge data reduction strategy to filter samples differently from existing approaches by measuring whether they can affect current decision accuracy. First, we put forward a novel adaptive data reduction framework for cloud-edge collaborative scenarios. Then, we present the implementation algorithms for filtering samples based on scenarios, identifying candidate scenarios emerging in edge environments, and updating edge scenarios. Experiment results show that in the best case, our approach can discard 70% samples while keeping the same inference accuracy with the original sample set.
场景自适应边缘数据约简
在边缘设备上部署预训练的机器学习模型以提高其智能变得越来越普遍。考虑到边缘环境的动态性,为了确保决策的准确性,边缘设备总是需要收集最新的样本并将其上传到云端以获得更新的模型。在此过程中,考虑到通信成本,确定哪些样本需要上传是至关重要的。我们提出了一种场景自适应边缘数据约简策略,通过测量它们是否会影响当前的决策精度来过滤与现有方法不同的样本。首先,针对云边缘协同场景,提出了一种新的自适应数据约简框架。然后,我们提出了基于场景过滤样本、识别边缘环境中出现的候选场景和更新边缘场景的实现算法。实验结果表明,在最好的情况下,我们的方法可以丢弃70%的样本,同时保持与原始样本集相同的推理精度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信