Towards Context-aware Automatic Haptic Effect Generation for Home Theatre Environments

Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology Pub Date : 2021-12-08 DOI:10.1145/3489849.3489887

Yaxuan Li, Yongjae Yoo, Antoine Weill--Duflos, J. Cooperstock

{"title":"Towards Context-aware Automatic Haptic Effect Generation for Home Theatre Environments","authors":"Yaxuan Li, Yongjae Yoo, Antoine Weill--Duflos, J. Cooperstock","doi":"10.1145/3489849.3489887","DOIUrl":null,"url":null,"abstract":"The application of haptic technology in entertainment systems, such as Virtual Reality and 4D cinema, enables novel experiences for users and drives the demand for efficient haptic authoring systems. Here, we propose an automatic multimodal vibrotactile content creation pipeline that substantially improves the overall hapto-audiovisual (HAV) experience based on contextual audio and visual content from movies. Our algorithm is implemented on a low-cost system with nine actuators attached to a viewing chair and extracts significant features from video files to generate corresponding haptic stimuli. We implemented this pipeline and used the resulting system in a user study (n = 16), quantifying user experience according to the sense of immersion, preference, harmony, and discomfort. The results indicate that the haptic patterns generated by our algorithm complement the movie content and provide an immersive and enjoyable HAV user experience. This further suggests that the pipeline can facilitate the efficient creation of 4D effects and could therefore be applied to improve the viewing experience in home theatre environments.","PeriodicalId":345527,"journal":{"name":"Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology","volume":"21 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3489849.3489887","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 6

Abstract

The application of haptic technology in entertainment systems, such as Virtual Reality and 4D cinema, enables novel experiences for users and drives the demand for efficient haptic authoring systems. Here, we propose an automatic multimodal vibrotactile content creation pipeline that substantially improves the overall hapto-audiovisual (HAV) experience based on contextual audio and visual content from movies. Our algorithm is implemented on a low-cost system with nine actuators attached to a viewing chair and extracts significant features from video files to generate corresponding haptic stimuli. We implemented this pipeline and used the resulting system in a user study (n = 16), quantifying user experience according to the sense of immersion, preference, harmony, and discomfort. The results indicate that the haptic patterns generated by our algorithm complement the movie content and provide an immersive and enjoyable HAV user experience. This further suggests that the pipeline can facilitate the efficient creation of 4D effects and could therefore be applied to improve the viewing experience in home theatre environments.

查看原文本刊更多论文

面向家庭影院环境的情境感知自动触觉效果生成

触觉技术在娱乐系统中的应用，如虚拟现实和4D影院，为用户带来了新颖的体验，并推动了对高效触觉创作系统的需求。在这里，我们提出了一个自动多模态振动触觉内容创建管道，该管道基于电影中的上下文音频和视觉内容，大大改善了整体触觉-视听(HAV)体验。我们的算法是在一个低成本的系统上实现的，该系统由9个执行器连接到一个观看椅上，并从视频文件中提取重要特征以产生相应的触觉刺激。我们实施了这个管道，并在用户研究中使用了最终的系统(n = 16)，根据沉浸感、偏好、和谐感和不适来量化用户体验。结果表明，我们的算法生成的触觉模式与电影内容相辅相成，提供了沉浸式和愉快的HAV用户体验。这进一步表明，管道可以促进4D效果的高效创造，因此可以应用于改善家庭影院环境中的观看体验。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

自引率

0.00%

发文量