Gain Without Pain: Enabling Real-time Environmental Perception on 2x Mobile Devices in Multiplayer Augmented Reality

Liang Dong, Xinjun Cai, Zheng Yang
{"title":"Gain Without Pain: Enabling Real-time Environmental Perception on 2x Mobile Devices in Multiplayer Augmented Reality","authors":"Liang Dong, Xinjun Cai, Zheng Yang","doi":"10.1109/ICPADS53394.2021.00070","DOIUrl":null,"url":null,"abstract":"Mobile multiplayer augmented reality(AR) emerges in various applications including games, education, training, etc. Edge computing technique enables real-time environmental perception ability(e.g. object detection and segmentation) of devices by offloading complex computation to the nearby edge server. However, with more players involved and offloading video streams, bandwidth competition intensifies and lengthens the transmission latency, which severely impairs the accuracy of environmental perception in multiplayer AR applications. We realize staggering offloading period of each device can reduce transmission latency and maintain real-time environmental perception when more players involved. We propose Bonus containing two key techniques: collaborative offloading scheduler to eliminate bandwidth competition among multiple devices, which improve the performance of the overall system to achieve “Pareto Efficiency”; time-aware video reshaper based on mainstream 802.11 protocol to enable Bonus compatible with most wireless scenarios. we evaluate Bonus and four SOTA solutions across 24 videos on different environmental perception tasks. Results demonstrate that Bonus achieves 119.5% accuracy and 1.9x player capacity compared to the closest baseline under wireless environment.","PeriodicalId":309508,"journal":{"name":"2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS)","volume":"3 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICPADS53394.2021.00070","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Mobile multiplayer augmented reality(AR) emerges in various applications including games, education, training, etc. Edge computing technique enables real-time environmental perception ability(e.g. object detection and segmentation) of devices by offloading complex computation to the nearby edge server. However, with more players involved and offloading video streams, bandwidth competition intensifies and lengthens the transmission latency, which severely impairs the accuracy of environmental perception in multiplayer AR applications. We realize staggering offloading period of each device can reduce transmission latency and maintain real-time environmental perception when more players involved. We propose Bonus containing two key techniques: collaborative offloading scheduler to eliminate bandwidth competition among multiple devices, which improve the performance of the overall system to achieve “Pareto Efficiency”; time-aware video reshaper based on mainstream 802.11 protocol to enable Bonus compatible with most wireless scenarios. we evaluate Bonus and four SOTA solutions across 24 videos on different environmental perception tasks. Results demonstrate that Bonus achieves 119.5% accuracy and 1.9x player capacity compared to the closest baseline under wireless environment.
不劳而获:在多人增强现实中在2x移动设备上实现实时环境感知
移动多人增强现实(AR)出现在游戏、教育、培训等各种应用中。边缘计算技术能够实现实时环境感知能力(例如:通过将复杂的计算卸载到附近的边缘服务器来实现设备的目标检测和分割。然而,随着更多玩家参与并卸载视频流,带宽竞争加剧并延长了传输延迟,这严重损害了多人AR应用中环境感知的准确性。我们意识到当玩家较多时,每个设备的错开卸载周期可以减少传输延迟并保持实时的环境感知。我们提出了包含两个关键技术的红利:协同卸载调度,消除多设备之间的带宽竞争,提高整个系统的性能,实现“帕累托效率”;基于主流802.11协议的时间感知视频重塑器,使奖金与大多数无线场景兼容。我们评估奖金和四个SOTA解决方案在不同的环境感知任务24个视频。结果表明,与无线环境下最接近的基线相比,Bonus实现了119.5%的准确率和1.9倍的播放器容量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信