Surin Ahn, M. Gorlatova, Parinaz Naghizadeh Ardabili, M. Chiang, Prateek Mittal
{"title":"Adaptive Fog-Based Output Security for Augmented Reality","authors":"Surin Ahn, M. Gorlatova, Parinaz Naghizadeh Ardabili, M. Chiang, Prateek Mittal","doi":"10.1145/3229625.3229626","DOIUrl":"https://doi.org/10.1145/3229625.3229626","url":null,"abstract":"Augmented reality (AR) technologies are rapidly being adopted across multiple sectors, but little work has been done to ensure the security of such systems against potentially harmful or distracting visual output produced by malicious or bug-ridden applications. Past research has proposed to incorporate manually specified policies into AR devices to constrain their visual output. However, these policies can be cumbersome to specify and implement, and may not generalize well to complex and unpredictable environmental conditions. We propose a method for generating adaptive policies to secure visual output in AR systems using deep reinforcement learning. This approach utilizes a local fog computing node, which runs training simulations to automatically learn an appropriate policy for filtering potentially malicious or distracting content produced by an application. Through empirical evaluations, we show that these policies are able to intelligently displace AR content to reduce obstruction of real-world objects, while maintaining a favorable user experience.","PeriodicalId":402876,"journal":{"name":"Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127048168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Predictive View Generation to Enable Mobile 360-degree and VR Experiences","authors":"Xueshi Hou, S. Dey, Jianzhong Zhang, M. Budagavi","doi":"10.1145/3229625.3229629","DOIUrl":"https://doi.org/10.1145/3229625.3229629","url":null,"abstract":"As 360-degree videos and virtual reality (VR) applications become popular for consumer and enterprise use cases, the desire to enable truly mobile experiences also increases. Delivering 360-degree videos and cloud/edge-based VR applications require ultra-high bandwidth and ultra-low latency [22], challenging to achieve with mobile networks. A common approach to reduce bandwidth is streaming only the field of view (FOV). However, extracting and transmitting the FOV in response to user head motion can add high latency, adversely affecting user experience. In this paper, we propose a predictive view generation approach, where only the predicted view is extracted (for 360-degree video) or rendered (in case of VR) and transmitted in advance, leading to a simultaneous reduction in bandwidth and latency. The view generation method is based on a deep-learning-based viewpoint prediction model we develop, which uses past head motions to predict where a user will be looking in the 360-degree view. Using a very large dataset consisting of head motion traces from over 36,000 viewers for nineteen 360-degree/VR videos, we validate the ability of our viewpoint prediction model and predictive view generation method to offer very high accuracy while simultaneously significantly reducing bandwidth.","PeriodicalId":402876,"journal":{"name":"Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network","volume":"32 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121800843","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
H. Ma, Xiaoke Jiang, Rui Ma, Zhiyou Ma, Yizhen Cai, D. Chiu
{"title":"Smart Streaming of Panoramic Videos","authors":"H. Ma, Xiaoke Jiang, Rui Ma, Zhiyou Ma, Yizhen Cai, D. Chiu","doi":"10.1145/3229625.3229628","DOIUrl":"https://doi.org/10.1145/3229625.3229628","url":null,"abstract":"The streaming of panoramic videos comes with a new challenge: adapting the streamed content to user attention. In this paper, by making some abstraction we study the key issues of the problem: (1) online content switching strategies, and (2) offline segmentation in preparation for adaptive streaming. Our work demonstrates how the problem depends fundamentally on user behavior, represented by user attention trajectories. Although we only relied on a typical real-world measured trajectory and two artificially generated benchmark trajectories, we point out how more knowledge of user attention can help optimize both the online and offline strategies.","PeriodicalId":402876,"journal":{"name":"Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129043033","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Joint Rate and FoV adaptation in immersive video streaming","authors":"Dongbiao He, C. Westphal, J. Garcia-Luna-Aceves","doi":"10.1145/3229625.3229630","DOIUrl":"https://doi.org/10.1145/3229625.3229630","url":null,"abstract":"The responsiveness of the network is critical when the application is immersive video streaming or 360 degree video streaming. The users look at the video stream on a display that can only show a fraction of the full video stream, and the time that the information spend in transit dramatically impacts the QoE of the end user. Further, transmitting a 360 degree video stream significantly increases the bandwidth usage and the impact on the already strained network. We propose a mechanism to use the responsiveness of the network to perform a Field of View (FoV) adaptation, so as to reduce the bandwidth consumption while at the same time enhancing the QoE of the user. In our simulation, such mechanism significantly improves the resolution seen by the end user, by selecting a higher bit rate. This translates to an improvement of up to 1.34 x better resolution when compared with the full spherical 360 degree video stream. Further, when rate adaption is used, it ensures the QoE of end users evolves according to the changes in the network conditions. This means that our proposed rate and FoV adaptation based upon the network responsiveness achieves both the apprently contradictory goals of increasing the end-user QoE and reducing the overall bandwidth consumption at the network layer.","PeriodicalId":402876,"journal":{"name":"Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127833485","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network","authors":"","doi":"10.1145/3229625","DOIUrl":"https://doi.org/10.1145/3229625","url":null,"abstract":"","PeriodicalId":402876,"journal":{"name":"Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network","volume":"38 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133047439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supporting Augmented Reality: Looking Beyond Performance","authors":"Lemuel Soh, J. Burke, Lixia Zhang","doi":"10.1145/3229625.3229627","DOIUrl":"https://doi.org/10.1145/3229625.3229627","url":null,"abstract":"Recent years have witnessed a surge in augmented reality (AR) applications in various markets and verticals, together with emerging toolkits and platforms to support new developments. However, the vision of a pervasive augmented reality held by many still seems a distance away. Notwithstanding the many ongoing efforts to tackle AR performance challenges, we argue that much attention is needed to other research areas including network architecture, security, privacy, and the development of business cases. Similar to the Web, existing AR applications are built upon TCP/IP protocol stack and rely on cloud computation. To enable pervasive AR applications, we believe that new computing paradigms, new approaches to network communications, and new business models need to be explored. Edge computing paradigms, which utilize performance advantage of server class hardware within physical vicinity, could achieve the required low latency while protecting user privacy. We further argue that Named Data Networking (NDN), a proposed new internet architecture, can be an enabler for pervasive AR by supporting local resource discovery, offering built-in communication security, and enabling experimentation with new business models. We hope that this position paper spurs greater thinking beyond performance improvements to push AR forward.","PeriodicalId":402876,"journal":{"name":"Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network","volume":"201 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123223411","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}