{"title":"Evaluating RGB+D hand posture detection methods for mobile 3D interaction","authors":"Daniel Fritz, Annette Mossel, H. Kaufmann","doi":"10.1145/2617841.2620715","DOIUrl":"https://doi.org/10.1145/2617841.2620715","url":null,"abstract":"In mobile applications it is crucial to provide intuitive means for 2D and 3D interaction. A large number of techniques exist to support a natural user interface (NUI) by detecting the user's hand posture in RGB+D (depth) data. Depending on a given interaction scenario, each technique has its advantages and disadvantages. To evaluate the performance of the various techniques on a mobile device, we conducted a systematic study by comparing the accuracy of five common posture recognition approaches with varying illumination and background. To be able to perform this study, we developed a powerful software framework that is capable of processing and fusing RGB and depth data directly on a handheld device. Overall results reveal best recognition rate of posture detection for combined RGB+D data at the expense of update rate. Finally, to support users in choosing the appropriate technique for their specific mobile interaction task, we derived guidelines based on our study.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129586872","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Benjamin Hervy, F. Laroche, J. Kerouanton, A. Bernard, C. Courtin, Laurence D'haene, Bertrand Guillet, Arnaud Waels
{"title":"Augmented historical scale model for museums: from curation to multi-modal promotion","authors":"Benjamin Hervy, F. Laroche, J. Kerouanton, A. Bernard, C. Courtin, Laurence D'haene, Bertrand Guillet, Arnaud Waels","doi":"10.1145/2617841.2617843","DOIUrl":"https://doi.org/10.1145/2617841.2617843","url":null,"abstract":"In this paper, we describe an interactive museum application dedicated to historical scale models. This comes from a joint work between multidisciplinary teams: industrial engineering researchers, historians, museum curators and interactive interface designer. We present here the result of the project, based on scientific methodology. Results include system architecture, hardware and software, some use cases and user evaluation figures. This paper also underlines some methodologies issues that illustrate future possibilities.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"34 5","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120987008","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
P. Omedas, Alberto Betella, R. Zucca, X. Arsiwalla, Daniel Pacheco, J. Wagner, F. Lingenfelser, E. André, D. Mazzei, A. Lanatà, A. Tognetti, D. Rossi, A. Grau-Saldes, Alex Goldhoorn, Edmundo Guerra, R. Alquézar, A. Sanfeliu, P. Verschure
{"title":"XIM-engine: a software framework to support the development of interactive applications that uses conscious and unconscious reactions in immersive mixed reality","authors":"P. Omedas, Alberto Betella, R. Zucca, X. Arsiwalla, Daniel Pacheco, J. Wagner, F. Lingenfelser, E. André, D. Mazzei, A. Lanatà, A. Tognetti, D. Rossi, A. Grau-Saldes, Alex Goldhoorn, Edmundo Guerra, R. Alquézar, A. Sanfeliu, P. Verschure","doi":"10.1145/2617841.2620714","DOIUrl":"https://doi.org/10.1145/2617841.2620714","url":null,"abstract":"The development of systems that allow multimodal interpretation of human-machine interaction is crucial to advance our understanding and validation of theoretical models of user behavior. In particular, a system capable of collecting, perceiving and interpreting unconscious behavior can provide rich contextual information for an interactive system. One possible application for such a system is in the exploration of complex data through immersion, where massive amounts of data are generated every day both by humans and computer processes that digitize information at different scales and resolutions thus exceeding our processing capacity. We need tools that accelerate our understanding and generation of hypotheses over the datasets, guide our searches and prevent data overload. We describe XIM-engine, a bio-inspired software framework designed to capture and analyze multi-modal human behavior in an immersive environment. The framework allows performing studies that can advance our understanding on the use of conscious and unconscious reactions in interactive systems.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"225 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134344298","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Alberto Betella, Ryszard Cetnarski, R. Zucca, X. Arsiwalla, Enrique Martínez Bueno, P. Omedas, A. Mura, P. Verschure
{"title":"BrainX3: embodied exploration of neural data","authors":"Alberto Betella, Ryszard Cetnarski, R. Zucca, X. Arsiwalla, Enrique Martínez Bueno, P. Omedas, A. Mura, P. Verschure","doi":"10.1145/2617841.2620726","DOIUrl":"https://doi.org/10.1145/2617841.2620726","url":null,"abstract":"We present BrainX3 as a novel immersive and interactive technology for exploration of large biological data, which in this paper is customized towards brain networks. Unlike traditional machine-inference systems, BrainX3 posits a two-way coupling of human intuition to powerful machine computation to tackle the big data challenge. Furthermore, through unobtrusive wearable sensors, BrainX3 can infer user's states in terms of arousal and cognitive workload, thus changing the visualization and the sonification parameters to boost the exploration process.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114477575","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Vazquez-Duchêne Marie-Danielle, M. Christophe, Mine Solène, J. Christine, Freis Olga, P. Gilles, Courtois Aurélie, Denis Alain
{"title":"Improving the human skin microanatomy understanding and skin aging observation with the SkinExplorer™ platform","authors":"Vazquez-Duchêne Marie-Danielle, M. Christophe, Mine Solène, J. Christine, Freis Olga, P. Gilles, Courtois Aurélie, Denis Alain","doi":"10.1145/2617841.2620694","DOIUrl":"https://doi.org/10.1145/2617841.2620694","url":null,"abstract":"Background: The skin includes 3 major layers: epidermis, dermis and hypodermis. With aging, the human skin becomes thinner and flattens with dermal papillae being less pronounced. The epidermis becomes fine-drawn and the dermal network deteriorates with decades. The three-dimensional structure of elastic network and the hyaluronic acid distribution are so complex, rich and dense that the conventional observation ways can only provide partial view of these components. Objective: The aim of this study was to demonstrate the morphological differences between two abdominal skin samples coming from young and aged donors based on elastic fibers organization and hyaluronic acid distribution. Methods: The SkinExplorer™ platform performs immersive and interactive exploration with virtual reality applications. Results: 2mm3 of histological data were obtained from 40 serial histological sections. Two three-dimensional numerical models from respectively young and aged skin biopsies were reconstructed. The observations were realized on the epidermis and dermal elastic fibers with the SkinExplorer™ platform and virtual reality (VR) applications. For hyaluronic acid repartition, two smaller models were reconstructed to see their richness and density by the same platform and VR tools. Conclusion: These results suggest that Virtual Reality applications can be a good tool for the observation of aging process with its assessing and understanding. Moreover, this tool of exploration offers new way of micro-anatomical research.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"53 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115828210","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
John McCormick, A. Nash, Stephanie Hutchison, K. Vincs, S. Nahavandi, D. Creighton
{"title":"Recognition: combining human interaction and a digital performing agent","authors":"John McCormick, A. Nash, Stephanie Hutchison, K. Vincs, S. Nahavandi, D. Creighton","doi":"10.1145/2617841.2620707","DOIUrl":"https://doi.org/10.1145/2617841.2620707","url":null,"abstract":"Virtual and augmented environments are often dependent on human intervention for change to occur. However there are times when it would be advantageous for appropriate human-like activity to still occur when there are no humans present. In this paper, we describe the installation art piece Recognition, which uses the movement of human participants to effect change, and the movement of a performing agent when there are no humans present. The agent's Artificial Neural Network has learnt appropriate movements from a dancer and is able to generate suitable movement for the main avatar in the absence of human participants.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"103 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116297327","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The touch of the avatar, artistic research and performance with synthetic doubles","authors":"Lucile Haute","doi":"10.1145/2617841.2620705","DOIUrl":"https://doi.org/10.1145/2617841.2620705","url":null,"abstract":"The evolution of digital technology created new relationships between body and their images. In performance, circumscribed body open itself to interactions with the environment and with other subjects, in different ways of participation or generativity. From 2010 to 2013, we conducted several experiments in this field including performances and artistic research around the figure of the avatar. These were designed to study the avatar, this extension acting and worth for oneself in digital networks, shared simulated platforms.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123966308","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Shimamura, Motoko Kanegae, Jun Morita, Yuji Uema, M. Inami, T. Hayashida, H. Saito, M. Sugimoto
{"title":"Virtual slicer: interactive visualizer for tomographic medical images based on position and orientation of handheld device","authors":"S. Shimamura, Motoko Kanegae, Jun Morita, Yuji Uema, M. Inami, T. Hayashida, H. Saito, M. Sugimoto","doi":"10.1145/2617841.2620697","DOIUrl":"https://doi.org/10.1145/2617841.2620697","url":null,"abstract":"This paper introduces an interface that helps understand the correspondence between the patient and medical images. Surgeons determine the extent of resection by using tomographic images such as MRI (Magnetic Resonance Imaging) data. However, understanding the relationship between the patient and tomographic images is difficult. This study aims to visualize the correspondence more intuitively. In this paper, we propose an interactive visualizer for medical images based on the relative position and orientation of the handheld device and the patient. We conducted an experiment to verify the performances of the proposed method and several other methods. In the experiment, the proposed method showed the minimum error.","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126507552","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 2014 Virtual Reality International Conference","authors":"","doi":"10.1145/2617841","DOIUrl":"https://doi.org/10.1145/2617841","url":null,"abstract":"","PeriodicalId":128331,"journal":{"name":"Proceedings of the 2014 Virtual Reality International Conference","volume":"379 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122178521","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}