Gun A. Lee, Theophilus Teo, Seungwon Kim, M. Billinghurst
{"title":"Mixed reality collaboration through sharing a live panorama","authors":"Gun A. Lee, Theophilus Teo, Seungwon Kim, M. Billinghurst","doi":"10.1145/3132787.3139203","DOIUrl":"https://doi.org/10.1145/3132787.3139203","url":null,"abstract":"One of the popular features on modern social networking platforms is sharing live 360 panorama video. This research investigates on how to further improve shared live panorama based collaborative experiences by applying Mixed Reality (MR) technology. Shared-Sphere is a wearable MR remote collaboration system. In addition to sharing a live captured immersive panorama, SharedSphere enriches the collaboration through overlaying MR visualisation of non-verbal communication cues (e.g., view awareness and gestures cues). User feedback collected through a preliminary user study indicated that sharing of live 360 panorama video was beneficial by providing a more immersive experience and supporting view independence. Users also felt that the view awareness cues were helpful for understanding the remote collaborator's focus.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131727479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pradeep Choudhary, Sumedh Mannar, Amit Kumar, Minjung Son
{"title":"Real-time face relighting via adaptive normal mapping","authors":"Pradeep Choudhary, Sumedh Mannar, Amit Kumar, Minjung Son","doi":"10.1145/3132787.3132789","DOIUrl":"https://doi.org/10.1145/3132787.3132789","url":null,"abstract":"In this paper, we present a real-time face relighting method for enhancing widely used face photographs such as `selfies'. In contrast with previous relighting methods that estimate and replace the real lighting condition with the intended one, our technique focuses on the aesthetic aspects of relighting with real-time interaction. We estimate the head pose based on the facial features and apply adaptive face normal mapping by transforming and interpolating pre-defined face normal maps. The lighting effect is calculated using adaptively mapped normals and overlaid on the original photograph. The experimental results show that the proposed method generates aesthetic face photographs without a computational overhead, enabling real-time face relighting for mobile applications.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115044058","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
V. Wanniarachchi, Owen Noel Newton Fernando, Yohan Fernandopulle
{"title":"Application of beacon technology for enhanced customer engagement in insurance companies","authors":"V. Wanniarachchi, Owen Noel Newton Fernando, Yohan Fernandopulle","doi":"10.1145/3132787.3139207","DOIUrl":"https://doi.org/10.1145/3132787.3139207","url":null,"abstract":"Enriched customer engagement is an inevitability when considering an enormous growth of every industry, and certainly, insurance is not an exception. With the rapid development of digital technologies and competitiveness between companies in the same industry or with alternative industries, businesses tend to excite their customers to obtain the competitive advantage. Conversely, with the understanding of the competitiveness of businesses, customers change their expectation and demand for a better service and engagement. As a result, digital technologies such as Bluetooth Low Energy Beacon technology overruled the existing methods of customer engagement. Though there are a lot of businesses which have adapted beacon technology to enhance customer engagement, there is lack of evidence of its adaptation in the insurance sector. Therefore, this paper aims to use beacon technology to enhance the customer engagement in insurance companies.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125712470","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Applying rotational tracking and photospherical imagery to immersive mobile telepresence and live video streaming groupware","authors":"Bektur Ryskeldiev, Michael Cohen, J. Herder","doi":"10.1145/3132787.3132813","DOIUrl":"https://doi.org/10.1145/3132787.3132813","url":null,"abstract":"Mobile live video streaming is becoming an increasingly popular form of interaction both in social media and remote collaboration scenarios. However, in most cases the streamed video does not take mobile devices' spatial data into account (e.g., the viewers do not know the spatial orientation of a streamer), or use such data only in specific scenarios (e.g., to navigate around a spherical video stream).","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"118 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132134136","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bot3D editor, easy 3D computer character animation editor for smartphones and tablets","authors":"Ryoichiro Debuchi","doi":"10.1145/3132787.3132807","DOIUrl":"https://doi.org/10.1145/3132787.3132807","url":null,"abstract":"We have developed a simple editing application that allows anyone to create 3D character animations using their smartphones and tablets. Previously, creating 3D character animations required special hardware and the ability to use specialized programs and tools.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130104444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"fingerT9: leveraging thumb-to-finger interaction for one-handed text entry on smartwatches","authors":"Pui Chung Wong, Kening Zhu, Hongbo Fu","doi":"10.1145/3132787.3132806","DOIUrl":"https://doi.org/10.1145/3132787.3132806","url":null,"abstract":"We introduce FingerT9, leveraging the action of thumb-to-finger touching and the surface of the finger segments, to support one-handed text entry on smartwatches. This is achieved by mapping a T9 keyboard layout on the surface of finger segments, combined with a predictive input method. Our solution avoids the problems of fat finger and screen occlusion, and enables text entry using a single hand. Eyes-free text entry is made possible once users are familiar with the keyboard layout. In other words, users can focus on the screen output during typing without looking at the keyboard layout mapped on the surface of finger segments.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"32 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130886179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Pasewaldt, Amir Semmo, Mandy Klingbeil, J. Döllner
{"title":"Pictory - neural style transfer and editing with coreML","authors":"S. Pasewaldt, Amir Semmo, Mandy Klingbeil, J. Döllner","doi":"10.1145/3132787.3132815","DOIUrl":"https://doi.org/10.1145/3132787.3132815","url":null,"abstract":"This work presents advances in the design and implementation of Pictory, an iOS app for artistic neural style transfer and interactive image editing using the CoreML and Metal APIs. Pictory combines the benefits of neural style transfer, e.g., high degree of abstraction on a global scale, with the interactivity of GPU-accelerated state-of-the-art image-based artistic rendering on a local scale. Thereby, the user is empowered to create high-resolution, abstracted renditions in a two-stage approach. First, a photo is transformed using a pre-trained convolutional neural network to obtain an intermediate stylized representation. Second, image-based artistic rendering techniques (e.g., watercolor, oil paint or toon filtering) are used to further stylize the image. Thereby, fine-scale texture noise---introduced by the style transfer---is filtered and interactive means are provided to individually adjust the stylization effects at run-time. Based on qualitative and quantitative user studies, Pictory has been redesigned and optimized to support casual users as well as mobile artists by providing effective, yet easy to understand, tools to facilitate image editing at multiple levels of control.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"50 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124835079","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"6DoF input for hololens using vive controller","authors":"Huidong Bai, Lei Gao, M. Billinghurst","doi":"10.1145/3132787.3132814","DOIUrl":"https://doi.org/10.1145/3132787.3132814","url":null,"abstract":"In this research we present a calibration method that enables 6 degree of freedom (DoF) interaction technology with high accuracy for the Microsoft HoloLens using HTC Vive controllers. We calibrate the HoloLens's front color camera with the Vive lighthouse sensors by tracking a reference image and a Vive tracker at the first beginning automatically, and the Vive controllers' position and pose data can be transmitted to the HoloLens in real time via the Bluetooth connection, which provides a more accurate and efficient input solution for users to manipulate the augmented content compared with the default gesture or head-gaze interfaces.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126529944","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tobias Dürschmid, Maximilian Söchting, Amir Semmo, Matthias Trapp, J. Döllner
{"title":"ProsumerFX: mobile design of image stylization components","authors":"Tobias Dürschmid, Maximilian Söchting, Amir Semmo, Matthias Trapp, J. Döllner","doi":"10.1145/3132787.3139208","DOIUrl":"https://doi.org/10.1145/3132787.3139208","url":null,"abstract":"With the continuous advances of mobile graphics hardware, high-quality image stylization is becoming feasible and increasingly used in casual creativity apps. The creative expression facilitated by these mobile apps, however, is typically limited with respect to the usage and application of pre-defined visual styles, which ultimately do not include their design and composition---an inherent requirement of prosumers. We present ProsumerFX, a GPU-based app that enables to interactively design parameterizable image stylization components on-device by reusing building blocks. Furthermore, the presentation of the effects can be customized by modifying the icons, names, and order of parameters and presets. Thereby, the customized visual styles are defined as platform-independent effects and can be shared with other users via a web-based platform and database. Together with the presented mobile app, this system approach supports collaborative works for designing visual styles, including their rapid prototyping, A/B testing, publishing, and distribution. Thus, it satisfies the needs for creative expression of both professionals as well as the general public.","PeriodicalId":243902,"journal":{"name":"SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications","volume":"195 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2017-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126170748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}