{"title":"更少获得更多关注:以人为本的新型磁共振远程协作装配方法,具有信息推荐和视觉增强功能","authors":"Yuxiang Yan, Xiaoliang Bai, Weiping He, Shuxia Wang, XiangYu Zhang, Liwei Liu, Qing Yu, Bing Zhang","doi":"10.1016/j.rcim.2024.102898","DOIUrl":null,"url":null,"abstract":"<div><div>Mixed reality remote collaboration assembly is a type of computer-supported collaborative assembly work that uses mixed reality technology to enable spatial information and collaboration status sharing among geographically distributed collaborators, including remote experts and local users. However, due to the abundance of mixed virtual and real-world information in the MR space and the limitations imposed by narrow field-of-view augmented reality (AR) glasses, users face challenges in effectively focusing on relevant and valuable visual information. Our research aims to enhance users' visual attention to critical guidance information in MR collaborative assembly tasks, thereby improving the clear expression of instructions and facilitating the transmission of collaborative intention. We developed the Information Recommendation and Visual Enhancement System (IRVES) through an assembly process information hierarchy division mechanism, a content-based information recommendation system, and a gesture interaction-based information visual enhancement method. IRVES can leverage the guidance expertise and preferences of remote experts to recommend information to filter out irrelevant information and present the key information that the remote expert conveys to the local user in an intuitive way through visual enhancement. We conducted a user study experiment of a collaborative assembly task of a small engine in a laboratory environment. The experimental results indicate that IRVES outperforms traditional MR remote collaborative assembly methods (VG3DV) in terms of time performance, operational errors, cognitive performance and user experience. Our research contributes a human-centered information visualization approach for remote experts and local users, providing a novel method and idea for designing visual information interfaces in MR remote collaboration assembly tasks.</div></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"92 ","pages":"Article 102898"},"PeriodicalIF":9.1000,"publicationDate":"2024-11-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Less gets more attention: A novel human-centered MR remote collaboration assembly method with information recommendation and visual enhancement\",\"authors\":\"Yuxiang Yan, Xiaoliang Bai, Weiping He, Shuxia Wang, XiangYu Zhang, Liwei Liu, Qing Yu, Bing Zhang\",\"doi\":\"10.1016/j.rcim.2024.102898\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Mixed reality remote collaboration assembly is a type of computer-supported collaborative assembly work that uses mixed reality technology to enable spatial information and collaboration status sharing among geographically distributed collaborators, including remote experts and local users. However, due to the abundance of mixed virtual and real-world information in the MR space and the limitations imposed by narrow field-of-view augmented reality (AR) glasses, users face challenges in effectively focusing on relevant and valuable visual information. Our research aims to enhance users' visual attention to critical guidance information in MR collaborative assembly tasks, thereby improving the clear expression of instructions and facilitating the transmission of collaborative intention. We developed the Information Recommendation and Visual Enhancement System (IRVES) through an assembly process information hierarchy division mechanism, a content-based information recommendation system, and a gesture interaction-based information visual enhancement method. IRVES can leverage the guidance expertise and preferences of remote experts to recommend information to filter out irrelevant information and present the key information that the remote expert conveys to the local user in an intuitive way through visual enhancement. We conducted a user study experiment of a collaborative assembly task of a small engine in a laboratory environment. The experimental results indicate that IRVES outperforms traditional MR remote collaborative assembly methods (VG3DV) in terms of time performance, operational errors, cognitive performance and user experience. Our research contributes a human-centered information visualization approach for remote experts and local users, providing a novel method and idea for designing visual information interfaces in MR remote collaboration assembly tasks.</div></div>\",\"PeriodicalId\":21452,\"journal\":{\"name\":\"Robotics and Computer-integrated Manufacturing\",\"volume\":\"92 \",\"pages\":\"Article 102898\"},\"PeriodicalIF\":9.1000,\"publicationDate\":\"2024-11-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Robotics and Computer-integrated Manufacturing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0736584524001856\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Computer-integrated Manufacturing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0736584524001856","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
Less gets more attention: A novel human-centered MR remote collaboration assembly method with information recommendation and visual enhancement
Mixed reality remote collaboration assembly is a type of computer-supported collaborative assembly work that uses mixed reality technology to enable spatial information and collaboration status sharing among geographically distributed collaborators, including remote experts and local users. However, due to the abundance of mixed virtual and real-world information in the MR space and the limitations imposed by narrow field-of-view augmented reality (AR) glasses, users face challenges in effectively focusing on relevant and valuable visual information. Our research aims to enhance users' visual attention to critical guidance information in MR collaborative assembly tasks, thereby improving the clear expression of instructions and facilitating the transmission of collaborative intention. We developed the Information Recommendation and Visual Enhancement System (IRVES) through an assembly process information hierarchy division mechanism, a content-based information recommendation system, and a gesture interaction-based information visual enhancement method. IRVES can leverage the guidance expertise and preferences of remote experts to recommend information to filter out irrelevant information and present the key information that the remote expert conveys to the local user in an intuitive way through visual enhancement. We conducted a user study experiment of a collaborative assembly task of a small engine in a laboratory environment. The experimental results indicate that IRVES outperforms traditional MR remote collaborative assembly methods (VG3DV) in terms of time performance, operational errors, cognitive performance and user experience. Our research contributes a human-centered information visualization approach for remote experts and local users, providing a novel method and idea for designing visual information interfaces in MR remote collaboration assembly tasks.
期刊介绍:
The journal, Robotics and Computer-Integrated Manufacturing, focuses on sharing research applications that contribute to the development of new or enhanced robotics, manufacturing technologies, and innovative manufacturing strategies that are relevant to industry. Papers that combine theory and experimental validation are preferred, while review papers on current robotics and manufacturing issues are also considered. However, papers on traditional machining processes, modeling and simulation, supply chain management, and resource optimization are generally not within the scope of the journal, as there are more appropriate journals for these topics. Similarly, papers that are overly theoretical or mathematical will be directed to other suitable journals. The journal welcomes original papers in areas such as industrial robotics, human-robot collaboration in manufacturing, cloud-based manufacturing, cyber-physical production systems, big data analytics in manufacturing, smart mechatronics, machine learning, adaptive and sustainable manufacturing, and other fields involving unique manufacturing technologies.