Taku Tanichi, Futa Asada, Kento Matsuda, D. Hynds, K. Minamizawa
{"title":"KABUTO: Inducing Upper-Body Movements using a Head Mounted Haptic Display with Flywheels","authors":"Taku Tanichi, Futa Asada, Kento Matsuda, D. Hynds, K. Minamizawa","doi":"10.1145/3415255.3422880","DOIUrl":"https://doi.org/10.1145/3415255.3422880","url":null,"abstract":"As an alternative to enhance user’s experience in VR contents, we propose KABUTO, a head mounted haptic display designed to induce upper-body movement by the application of kinesthetic feedback to the head. KABUTO can provide impact and resistance by using flywheels and brakes in response to various head movements, as extensive head movements lead to dynamic movement throughout the upper body. We have also designed an application which enables the user to become a rhinoceros beetle.The user can feel the weight of the swinging horn or the impact of the horn flinging object. In the demonstration of it, we observed that KABUTO makes users move their upper body aggressively.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128853982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pat Pataranutaporn, Ali Shtarbanov, Glenn Fernandes, Jingwen Li, Parinya Punpongsanon, Joe A. Paradiso, P. Maes
{"title":"Wearable Sanitizer: Design and Implementation of an Open-source, On-body Sanitizer","authors":"Pat Pataranutaporn, Ali Shtarbanov, Glenn Fernandes, Jingwen Li, Parinya Punpongsanon, Joe A. Paradiso, P. Maes","doi":"10.1145/3415255.3422897","DOIUrl":"https://doi.org/10.1145/3415255.3422897","url":null,"abstract":"During the pandemic, wearables such as face masks and face shields have become broadly adopted, these solutions do reduce infection but do not eliminate infectious agents from surfaces and objects the person may touch. Therefore, regular disinfection of hands and frequently touched surfaces is a critical factor in preventing the spread of infectious diseases ranging from the common cold and flu to SARS and COVID-19. This activity of frequent disinfection requires a high degree of discipline and leads to increased cognitive and physical effort involved in frequent washing of hands or use of a pocket sanitizer. We present an open-source, wearable sanitizer that provides just-in-time, automatic dispensing of alcohol to the wearer’s hand or nearby objects using sensors and programmable cues. We systematically explore the design space aiming to create a device that not only seamlessly integrates with the user’s body and behavior but also frees their physical and mental faculties for other tasks.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130476624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Takuro Furumoto, M. Fujiwara, Yasutoshi Makino, H. Shinoda
{"title":"Balloon Interface for Midair Haptic Interaction","authors":"Takuro Furumoto, M. Fujiwara, Yasutoshi Makino, H. Shinoda","doi":"10.1145/3415255.3422882","DOIUrl":"https://doi.org/10.1145/3415255.3422882","url":null,"abstract":"Midair physical prop is a promising tool to facilitate intuitive human-computer interaction in a three-dimensional (3D) space. In such systems, it is challenging to guarantee safety and comfort during interaction with real objects in high-speed 3D motion. In this paper, we propose a balloon interface, a midair physical prop that affords direct single-handed manipulation in a safe manner. The system uses a spherical helium-filled balloon controlled by surrounding ultrasound phased array transducers as a physical prop. It is safe to collide even when it is moving fast because it has an elastic body and does not have any mechanical parts. Fast switching of driving transducer units and closed-loop control based on a high-speed measurement system result in the 3D control of an object of a size that affords a spherical grasp, e.g., a spherical balloon of 10-cm diameter.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126168999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"MAScreen: Augmenting Speech with Visual Cues of Lip Motions, Facial Expressions, and Text Using a Wearable Display","authors":"Hyein Lee, Yoon-Ji Kim, Andrea Bianchi","doi":"10.1145/3415255.3422886","DOIUrl":"https://doi.org/10.1145/3415255.3422886","url":null,"abstract":"Personal protective equipment, particularly face masks, have become increasingly common with the rise of global health issues, such as fine-dust storms and pandemics. Face masks, however, also degrade speech intelligibility by effectively occluding visual cues, such as lip motions and facial expressions. In this paper, we propose MAScreen, a wearable LED display in the shape of a mask, which is capable of sensing lip motion and speech and provides real-time visual feedback of the mouth behind the mask.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"183 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121943654","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"HexTouch: A Wearable Haptic Robot for Complementary Interactions to Companion Agents in Virtual Reality","authors":"Ran Zhou, Yanzhe Wu, Harpreet Sareen","doi":"10.1145/3415255.3422881","DOIUrl":"https://doi.org/10.1145/3415255.3422881","url":null,"abstract":"We propose a forearm-mounted robot that performs complementary touches in relation to the behaviors of a companion agent in virtual reality (VR). The robot consists of a series of tactors driven by servo motors that render specific tactile patterns to communicate primary emotions (fear, happiness, disgust, anger, and sympathy) and other notification cues. We showcase this through a VR game with physical-virtual agent interactions that facilitate the player-companion relationship and increase user immersion in specific scenarios. The player collaborates with the agent to complete a mission while receiving affective haptic cues with the potential to enhance sociality in the virtual world.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121315890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Demonstration of ElaStick: A Variable Stiffness Display for Rendering Handheld Flexible Object","authors":"Neung Ryu, Myung Jin Kim, Andrea Bianchi","doi":"10.1145/3415255.3422894","DOIUrl":"https://doi.org/10.1145/3415255.3422894","url":null,"abstract":"We present ElaStick, a handheld variable stiffness controller capable of simulating the kinesthetic sensation of deformable and flexible objects when swung or shaken. ElaStick is capable of rendering gradual changes of stiffness along two independent axes over a wide continuous range. Two trackers on the controller enable a closed-loop feedback that allows to accurately map the device’s deformations to the visuals of a Virtual Reality application.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129886449","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ikuo Kamei, Changyo Han, T. Hiraki, S. Fukushima, T. Naemura
{"title":"CoVR: Co-located Virtual Reality Experience Sharing for Facilitating Joint Attention via Projected View of HMD Users","authors":"Ikuo Kamei, Changyo Han, T. Hiraki, S. Fukushima, T. Naemura","doi":"10.1145/3415255.3422883","DOIUrl":"https://doi.org/10.1145/3415255.3422883","url":null,"abstract":"Sharing virtual reality (VR) experiences between users wearing head-mounted displays (HMD users) and users not wearing HMDs (Non-HMD users) is a promising approach that can help bridge the gap between these users’ experiences. In previous studies, the role of these users and the differences in their attention targets were not considered, causing a lack of joint attention in user communication. Also, previous systems required cumbersome installation in the spaces in which VR was being experienced. Therefore, this paper proposes “CoVR,” a co-located VR sharing system comprising an HMD with a focus-free projector and projecting the perspective of HMD users. Further, we introduce a design methodology for controlling the perspective of the images displayed to the HMD and Non-HMD users. We also discuss three application scenarios where additional information provided are different for each user.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"166 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114429213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Miguel Altamirano Cabrera, Igor Usachev, Juan Heredia, Jonathan Tirado, A. Fedoseev, D. Tsetserukou
{"title":"MaskBot: Real-time Robotic Projection Mapping with Head Motion Tracking","authors":"Miguel Altamirano Cabrera, Igor Usachev, Juan Heredia, Jonathan Tirado, A. Fedoseev, D. Tsetserukou","doi":"10.1145/3415255.3422896","DOIUrl":"https://doi.org/10.1145/3415255.3422896","url":null,"abstract":"The projection mapping systems on the human face are limited by the process latency and the users’ movement. The area of the projection is restricted by the position of the projectors and cameras. We are introducing MaskBot, a real-time projection mapping system guided by a 6 Degrees of Freedom (DoF) collaborative robot. The collaborative robot locates the projector and camera in front of the user’s face to increase the projection area and reduce the system’s latency. A webcam is used to detect the face orientation and to measure the robot-user distance. Based on this information we modify the projection size and orientation. MaskBot projects different images on the user’s face, such as face modifications, make-up, and logos. In contrast to the existing methods, the presented system is the first that introduces a robotic projection mapping. One of the prospective applications is to acquire a dataset of adversarial images to challenge face detection DNN systems, such as Face ID.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128488499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ilya Zakharkin, A. Tsaturyan, Miguel Altamirano Cabrera, Jonathan Tirado, D. Tsetserukou
{"title":"ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition","authors":"Ilya Zakharkin, A. Tsaturyan, Miguel Altamirano Cabrera, Jonathan Tirado, D. Tsetserukou","doi":"10.1145/3415255.3422892","DOIUrl":"https://doi.org/10.1145/3415255.3422892","url":null,"abstract":"We present ZoomTouch, a breakthrough technology for multi-user and real-time control of robot from Zoom by DNN-based gesture recognition. The users can have a video conferencing in a digital world and at the same time to perform dexterous manipulations with tangible objects by remote robot. As the scenario, we proposed the remote robotic COVID-19 test Laboratory to substitute medical assistant working in protective gear in close proximity with infected cells and to considerably reduce the time to receive the test results. The proposed technology suggests a new type of reality, where multi-users can jointly interact with remote object, e.g. make a new building design, joint cooking in robotic kitchen, etc, and discuss/modify the results at the same time.","PeriodicalId":344160,"journal":{"name":"SIGGRAPH Asia 2020 Emerging Technologies","volume":"101 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126332177","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}