Virtual Reality Intelligent Hardware最新文献

{"title":"Building the metaverse using digital twins at all scales,states, and relations","authors":"Zhihan Lv ,&nbsp;Shuxuan Xie ,&nbsp;Yuxi Li ,&nbsp;M. Shamim Hossain ,&nbsp;Abdulmotaleb El Saddik","doi":"10.1016/j.vrih.2022.06.005","DOIUrl":"10.1016/j.vrih.2022.06.005","url":null,"abstract":"<div><p>Developments in new-generation information technology have enabled Digital Twins to reshape the physical world into a virtual digital space and provide technical support for constructing the Metaverse. Metaverse objects can be at the micro-, meso-, or macroscale. The Metaverse is a complex collection of solid, liquid, gaseous, plasma, and other uncertain states. Additionally, the Metaverse integrates tangibles with social relations, such as interpersonal (friends, partners, and family) and social relations (ethics, morality, and law). This review introduces some principles and laws, such as broken windows theory, small-world phenomenon, survivor bias, and herd behavior, for constructing a Digital Twins model for social relations. Therefore, from multiple perspectives, this article reviews mappings of tangible and intangible real-world objects to the Metaverse using the Digital Twins model.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 6","pages":"Pages 459-470"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096579622000602/pdf?md5=a21672be799f10764afb283c622bf66e&pid=1-s2.0-S2096579622000602-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125427534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Virtual-reality and intelligent hardware in Digital Twins","authors":"Zhihan Lv ,&nbsp;Gustavo Marfia ,&nbsp;Fabio Poiesi ,&nbsp;Neil Vaughan ,&nbsp;Jun Shen","doi":"10.1016/j.vrih.2022.12.002","DOIUrl":"https://doi.org/10.1016/j.vrih.2022.12.002","url":null,"abstract":"","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 6","pages":"Pages ii-iii"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S209657962200119X/pdfft?md5=755bb2bee1170735d64f4777580f22dd&pid=1-s2.0-S209657962200119X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"137332471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Gamification and virtual reality for digital twin learning and training: architecture and challenges","authors":"Antonio Bucchiarone","doi":"10.1016/j.vrih.2022.08.001","DOIUrl":"10.1016/j.vrih.2022.08.001","url":null,"abstract":"<div><h3>Background</h3><p>Digital Twins are becoming increasingly popular in a variety of industries to manage complex systems. As digital twins become more sophisticated, there is an increased need for effective training and learning systems. Teachers, project leaders, and tool vendors encounter challenges while teaching and training their students, co-workers, and users.</p></div><div><h3>Methods</h3><p>In this study, we propose a new method for training users in using digital twins by proposing a gamified and virtual environment. We present an overall architecture and discuss its practical realization.</p></div><div><h3>Results</h3><p>We propose a set of future challenges that we consider critical to enabling a more effective learning/training approach.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 6","pages":"Pages 471-486"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096579622000675/pdf?md5=1f5d10204032946a0174a86ac8d874c9&pid=1-s2.0-S2096579622000675-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117231940","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Resource requirements of an edge-based digital twin service: an experimental study","authors":"Federico Mungari ,&nbsp;Milan Groshev ,&nbsp;Carla Fabiana Chiasserini","doi":"10.1016/j.vrih.2022.05.005","DOIUrl":"10.1016/j.vrih.2022.05.005","url":null,"abstract":"<div><p>Digital Twin (DT) is a pivotal application under the industrial digital transformation envisaged by the fourth industrial revolution (Industry 4.0). DT defines intelligent and real-time faithful reflections of physical entities such as industrial robots, thus allowing their remote control. Relying on the latest advances in Information and Communication Technologies (ICT), namely Network Function Virtualization (NFV) and Edge-computing, DT can be deployed as an on-demand service in the factories close proximity and offered leveraging radio access technologies. However, with the purpose of achieving the well-known scalability, flexibility, availability and performance guarantees benefits foreseen by the latest ICT, it is steadily required to experimentally profile and assess DT as a Service (DTaaS) solutions. Moreover, the dependencies between the resources claimed by the service and the relative demand and work loads require to be investigated. In this work, an Edge-based Digital Twin solution for remote control of robotic arms is deployed in an experimental testbed where, in compliance with the NFV paradigm, the service has been segmented in virtual network functions. Our research has primarily the objective to evaluate the entanglement among overall service performance and VNFs resource requirements, and the number of robots consuming the service varies. Experimental profiles show the most critical DT features to be the inverse kinematics and trajectory computations. Moreover, the same analysis has been carried out as a function of the industrial processes, namely based on the commands imposed on the robots, and particularly of their ion-level, resulting in a novel trade-off between computing and time resources requirements and trajectory guarantees. The derived results provide crucial insights for the design of network service scaling and resource orchestration frameworks dealing with DTaaS applications. Finally, we empirically prove LTE shortage to accommodate the minimum DT latency requirements.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 6","pages":"Pages 506-520"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096579622000468/pdf?md5=278ade4e61768e11ed83f5e854380732&pid=1-s2.0-S2096579622000468-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122930596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Digital twins and multi-access edge computing for IIoT","authors":"Andreas P. Plageras,&nbsp;Konstantinos E. Psannis","doi":"10.1016/j.vrih.2022.07.005","DOIUrl":"10.1016/j.vrih.2022.07.005","url":null,"abstract":"<div><h3>Background</h3><p>All recent technological findings can be collectively used to strengthen the industrial Internet of things (IIoT) sector. The novel technology of multi-access edge computing or mobile edge computing (MEC) and digital twins have advanced rapidly in the industry. MEC is the middle layer between mobile devices and the cloud, and it provides scalability, reliability, security, efficient control, and storage of resources. Digital twins form a communication model that enhances the entire system by improving latency, overhead, and energy consumption.</p></div><div><h3>Methods</h3><p>The main focus in this study is the biggest challenges that researchers in the field of IIoT have to overcome to obtain a more efficient communication environment in terms of technology integration, efficient energy and data delivery, storage spaces, security, and real-time control and analysis. Thus, a distributed system is established in a local network, in which several functions operate. In addition, an MEC-based framework is proposed to reduce traffic and latency by merging the processing of data generated by IIoT devices at the edge of the network. The critical parts of the proposed IIoT system are evaluated by using emulation software.</p></div><div><h3>Results</h3><p>The results show that data delivery and offloading are performed more efficiently, energy consumption and processing are improved, and security, complexity, control, and reliability are enhanced.</p></div><div><h3>Conclusions</h3><p>The proposed framework and application provide authentication and integrity to end users and IoT devices.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 6","pages":"Pages 521-534"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096579622000663/pdf?md5=235db91e4789f7379fba3ed9c4a28582&pid=1-s2.0-S2096579622000663-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134483006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Empowering digital twins with eXtended reality collaborations","authors":"Lorenzo Stacchio ,&nbsp;Alessia Angeli ,&nbsp;Gustavo Marfia","doi":"10.1016/j.vrih.2022.06.004","DOIUrl":"10.1016/j.vrih.2022.06.004","url":null,"abstract":"<div><h3>Background</h3><p>The advancements of Artificial Intelligence, Big Data Analytics, and the Internet of Things paved the path to the emergence and use of Digital Twins (DTs) as technologies to “twin” the life of a physical entity in different fields, ranging from industry to healthcare. At the same time, the advent of eXtended Reality (XR) in industrial and consumer electronics has provided novel paradigms that may be put to good use to visualize and interact with DTs. XR technologies can support human-to-human interactions for training and remote assistance and could transform DTs into collaborative intelligence tools.</p></div><div><h3>Methods</h3><p>We here present the Human Collaborative Intelligence empowered Digital Twin framework (HCLINT-DT) integrating human annotations (e.g., textual and vocal) to allow the creation of an all-in-one-place resource to preserve such knowledge. This framework could be adopted in many fields, supporting users to learn how to carry out an unknown process or explore others’ past experiences.</p></div><div><h3>Results</h3><p>The assessment of such a framework has involved implementing a DT supporting human annotations, reflected in both the physical world (Augmented Reality) and the virtual one (Virtual Reality).</p></div><div><h3>Conclusions</h3><p>The outcomes of the interface design assessment confirm the interest in developing HCLINT-DT-based applications. Finally, we evaluated how the proposed framework could be translated into a manufacturing context.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 6","pages":"Pages 487-505"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096579622000596/pdf?md5=dbbbd385704b8ee92e82ea24028f0302&pid=1-s2.0-S2096579622000596-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133263365","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Uncanny valley for interactive social agents: an experimental study","authors":"Nidhi Mishra ,&nbsp;Manoj Ramanathan ,&nbsp;Gauri Tulsulkar ,&nbsp;Nadia Magneat Thalmann","doi":"10.1016/j.vrih.2022.08.003","DOIUrl":"10.1016/j.vrih.2022.08.003","url":null,"abstract":"<div><h3>Background</h3><p>The uncanny valley hypothesis states that users may experience discomfort when interacting with almost human-like artificial characters. Advancements in artificial intelligence, robotics, and computer graphics have led to the development of life-like virtual humans and humanoid robots. Revisiting this hypothesis is necessary to check whether they positively or negatively affect the current population, who are highly accustomed to the latest technologies.</p></div><div><h3>Methods</h3><p>In this study, we present a unique evaluation of the uncanny valley hypothesis by allowing participants to interact live with four humanoid robots that have varying levels of human-likeness. Each participant completed a survey questionnaire to evaluate the affinity of each robot. Additionally, we used deep learning methods to quantify the participants’ emotional states using multimodal cues, including visual, audio, and text cues, by recording the participant–robot interactions.</p></div><div><h3>Results</h3><p>Multi-modal analysis and surveys provided interesting results and insights into the uncanny valley hypothesis.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 5","pages":"Pages 393-405"},"PeriodicalIF":0.0,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S209657962200078X/pdf?md5=006cc0cfa178979a31eb04f193763508&pid=1-s2.0-S209657962200078X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125618019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Computer graphics for metaverse","authors":"Nadia Magnenat Thalmann ,&nbsp;Jinman Kim ,&nbsp;George Papagiannakis ,&nbsp;Daniel Thalmann ,&nbsp;Bin Sheng","doi":"10.1016/j.vrih.2022.10.001","DOIUrl":"10.1016/j.vrih.2022.10.001","url":null,"abstract":"","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 5","pages":"Pages ii-iv"},"PeriodicalIF":0.0,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096579622000997/pdfft?md5=3e3da9d06de21804e1f0dbe952be9beb&pid=1-s2.0-S2096579622000997-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121178249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"DSD-MatchingNet: Deformable sparse-to-dense feature matching for learning accurate correspondences","authors":"Yicheng Zhao ,&nbsp;Han Zhang ,&nbsp;Ping Lu ,&nbsp;Ping Li ,&nbsp;Enhua Wu ,&nbsp;Bin Sheng","doi":"10.1016/j.vrih.2022.08.007","DOIUrl":"10.1016/j.vrih.2022.08.007","url":null,"abstract":"<div><h3>Background</h3><p>Exploring correspondences across multiview images is the basis of various computer vision tasks. However, most existing methods have limited accuracy under challenging conditions.</p></div><div><h3>Method</h3><p>To learn more robust and accurate correspondences, we propose DSD-MatchingNet for local feature matching in this study. First, we develop a deformable feature extraction module to obtain multilevel feature maps, which harvest contextual information from dynamic receptive fields. The dynamic receptive fields provided by the deformable convolution network ensure that our method obtains dense and robust correspondence. Second, we utilize sparse-to-dense matching with symmetry of correspondence to implement accurate pixel-level matching, which enables our method to produce more accurate correspondences.</p></div><div><h3>Result</h3><p>Experiments show that our proposed DSD-MatchingNet achieves a better performance on the image matching benchmark, as well as on the visual localization benchmark. Specifically, our method achieved 91.3% mean matching accuracy on the HPatches dataset and 99.3% visual localization recalls on the Aachen Day-Night dataset.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 5","pages":"Pages 432-443"},"PeriodicalIF":0.0,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2096579622000821/pdf?md5=b3b9d92de1f1714de8cb8ab71d43808f&pid=1-s2.0-S2096579622000821-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133210436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Virtual reality for immersive multi-user firefighter-training scenarios","authors":"Philipp Braun,&nbsp;Michaela Grafelmann,&nbsp;Felix Gill,&nbsp;Hauke Stolz,&nbsp;Johannes Hinckeldeyn,&nbsp;Ann-Kathrin Lange","doi":"10.1016/j.vrih.2022.08.006","DOIUrl":"10.1016/j.vrih.2022.08.006","url":null,"abstract":"<div><h3>Background</h3><p>Virtual reality (VR) applications can be used to provide comprehensive training scenarios that are difficult or impossible to represent in physical configurations. This includes team training for emergency services such as firefighting. Creating a high level of immersion is essential for achieving effective virtual training. In this respect, motion-capture systems offer the possibility of creating highly immersive multi-user training experiences, including full-body avatars.</p></div><div><h3>Methods</h3><p>This study presents a preliminary prototype that helps extinguish a virtual fire on a container ship as a VR training scenario. The prototype provides a full-body and multi-user VR experience based on the synthesis of position data provided by the motion-capture system and orientation data from the VR headsets. Moreover, the prototype facilitates an initial evaluation of the results.</p></div><div><h3>Results</h3><p>The results confirm the value of using VR for training procedures that are difficult to implement in the real world. Furthermore, the results show that motion-capture-based VR technologies are particularly useful for firefighting training, in which participants can collaborate in difficult-to-access environments. However, this study also indicates that increasing the immersion in such training remains a challenge.</p></div><div><h3>Conclusions</h3><p>This study presents a prototypical VR application that enables the multi-user training of maritime firefighters. Future research should evaluate the initial results, provide more extensive training scenarios, and measure the training progress.</p></div>","PeriodicalId":33538,"journal":{"name":"Virtual Reality Intelligent Hardware","volume":"4 5","pages":"Pages 406-417"},"PeriodicalIF":0.0,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S209657962200081X/pdf?md5=1287c6b99ffe058108e336cc8bf7aca8&pid=1-s2.0-S209657962200081X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131573670","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}