Metaverse-based remote support system with smooth combination of free viewpoint observation and hand gesture instruction

IF 1.7 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
Takashi Numata, Yuya Ogi, Keiichi Mitani, Kazuyuki Tajima, Yusuke Nakamura, Naohito Ikeda, Kenichi Shimada
{"title":"Metaverse-based remote support system with smooth combination of free viewpoint observation and hand gesture instruction","authors":"Takashi Numata,&nbsp;Yuya Ogi,&nbsp;Keiichi Mitani,&nbsp;Kazuyuki Tajima,&nbsp;Yusuke Nakamura,&nbsp;Naohito Ikeda,&nbsp;Kenichi Shimada","doi":"10.1002/jsid.1339","DOIUrl":null,"url":null,"abstract":"<p>In field operations with large machines, onsite large task spaces have been typically required. In these cases, remote skilled workers have to provide a step-by-step guide by observing the onsite situation around the large task spaces in three dimensions, instructing onsite unskilled workers on how to perform the tasks with the correct hand gestures at the right position, and switching between observation and instruction frequently during the remote support. In this study, we developed a Metaverse-based remote support system with a seamless user interface for switching between free viewpoint observation and hand gesture instruction. The proposed system enables remote skilled workers to observe the onsite field from any viewpoint, transfer hand gesture instruction to onsite workers, and seamlessly switch between free viewpoint observation and free hand gesture instruction without having to change devices. We compared the time efficiency of the proposed system and a conventional system through experiments with 28 users and found that our system improved the observation time efficiency by 65.7%, the instruction time efficiency by 27.9%, and the switching time efficiency between observation and instruction by 14.6%. These results indicate that the proposed system enables remote skilled workers to support onsite workers quickly and efficiently.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":1.7000,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jsid.1339","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Society for Information Display","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/jsid.1339","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

In field operations with large machines, onsite large task spaces have been typically required. In these cases, remote skilled workers have to provide a step-by-step guide by observing the onsite situation around the large task spaces in three dimensions, instructing onsite unskilled workers on how to perform the tasks with the correct hand gestures at the right position, and switching between observation and instruction frequently during the remote support. In this study, we developed a Metaverse-based remote support system with a seamless user interface for switching between free viewpoint observation and hand gesture instruction. The proposed system enables remote skilled workers to observe the onsite field from any viewpoint, transfer hand gesture instruction to onsite workers, and seamlessly switch between free viewpoint observation and free hand gesture instruction without having to change devices. We compared the time efficiency of the proposed system and a conventional system through experiments with 28 users and found that our system improved the observation time efficiency by 65.7%, the instruction time efficiency by 27.9%, and the switching time efficiency between observation and instruction by 14.6%. These results indicate that the proposed system enables remote skilled workers to support onsite workers quickly and efficiently.

Abstract Image

基于 Metaverse 的远程支持系统,将自由视角观察和手势指令流畅地结合在一起
在使用大型机器的现场作业中,通常需要现场大型任务空间。在这种情况下,远程技术工人必须通过三维观察大型任务空间周围的现场情况,指导现场非技术工人如何在正确的位置用正确的手势执行任务,并在远程支持过程中频繁切换观察和指导,从而提供循序渐进的指导。在这项研究中,我们开发了一个基于 Metaverse 的远程支持系统,该系统具有无缝用户界面,可在自由视角观察和手势指导之间进行切换。该系统使远程技术工人能够从任何视角观察现场情况,向现场工人传输手势指令,并在自由视角观察和自由手势指令之间无缝切换,而无需更换设备。我们通过对 28 名用户进行实验,比较了拟议系统和传统系统的时间效率,发现我们的系统将观察时间效率提高了 65.7%,将指令时间效率提高了 27.9%,将观察和指令之间的切换时间效率提高了 14.6%。这些结果表明,建议的系统能让远程技术工人快速高效地为现场工人提供支持。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of the Society for Information Display
Journal of the Society for Information Display 工程技术-材料科学:综合
CiteScore
4.80
自引率
8.70%
发文量
98
审稿时长
3 months
期刊介绍: The Journal of the Society for Information Display publishes original works dealing with the theory and practice of information display. Coverage includes materials, devices and systems; the underlying chemistry, physics, physiology and psychology; measurement techniques, manufacturing technologies; and all aspects of the interaction between equipment and its users. Review articles are also published in all of these areas. Occasional special issues or sections consist of collections of papers on specific topical areas or collections of full length papers based in part on oral or poster presentations given at SID sponsored conferences.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信