Kailiang Shou, Qianyu Meng, Qingshu Yuan, Qihao Yang, Zhigeng Pan
{"title":"A Multimodal Natural Interaction-Based Mixed Reality System for Limb Rehabilitation","authors":"Kailiang Shou, Qianyu Meng, Qingshu Yuan, Qihao Yang, Zhigeng Pan","doi":"10.1109/ICVR57957.2023.10169638","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169638","url":null,"abstract":"The virtual rehabilitation system is designed to aid in the recovery of patients’ motor functions and cognitive disorders. It employs technologies such as virtual reality, human-computer interaction, and sensors. Compared to traditional rehabilitation systems, virtual rehabilitation systems have many advantages, such as providing multiple therapeutic scenarios, high entertainment, strong system replicability, and accurate quantitative evaluation. However, current virtual rehabilitation systems still face challenges, including a limited variety of training content, insufficient interaction experience, and a single mode of interaction, which negatively affect the practical experience of patients. To address these problems, this paper proposes a multimodal natural interaction technology based on gestures, tangible objects, and natural walking for patients with limb impairments, and designs a mixed reality rehabilitation system. User research showed that compared to the controller interaction mode, the multimodal natural interaction mode is more interesting and has a stronger sense of realism, enhancing participants’ enthusiasm and motivation.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134269458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Interactively Rejioning 2D Oracle Bone Fragments Based on Contour Matching","authors":"Yifan Jin, Xi Yang","doi":"10.1109/ICVR57957.2023.10169751","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169751","url":null,"abstract":"The oracle bone fragments are usually rejoined manually by experts. This is a very challenging task because of the huge number of fragments and the complexity of the breakage situation, which leads to low efficiency of manual search and low accuracy of results. In this paper, we explore a computer-aided technology in 2D oracle rubbings rejoining to accelerate the matching and searching process. We provide an oracle rejoining pipeline and interactive interfaces to integrate contour extraction, matching, searching, and merging of fragments. Besides, we conduct experiments on a real oracle bone dataset, and the results demonstrate that our technology finds the correct matching fragments within a certain rank and achieves satisfactory final matching results.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114351477","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rong Guan, Liang Wang, Lingling Xu, H. Li, Lei Zhao
{"title":"Digital Restoration of the Grand Canal Grain Transporting Boats in the Ming Dynasty","authors":"Rong Guan, Liang Wang, Lingling Xu, H. Li, Lei Zhao","doi":"10.1109/ICVR57957.2023.10169538","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169538","url":null,"abstract":"The Canal transport system was an important financial system in the Ming Dynasty, in which the waterways were used to transfer grain from the south to supply the salaries of the officials in the capital and to feed the military. It is a professional transportation that uses waterways (river and sea) to transport grain. The boats transporting grain were called Cao boats, grain boats or transport boats in the historical records of the Ming Dynasty, and their styles were called shallow flat-bottom boats and sea-going vessels. This article mainly deconstructs the hull structure and manufacturing process of the grain boat (shallow flat-bottom boat) on the Grand Canal in detail, and representing it through 3D modeling, and digitally restores it through rendering.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"125 7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132278622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Research on the Solution and Simulation of the Two-Dimensional Heat Equation","authors":"Liu Lu, Zhang Zhiyi","doi":"10.1109/ICVR57957.2023.10169570","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169570","url":null,"abstract":"Numerical calculation methods with high precision and fast speed are crucial for solving heat conduction problems, a method for solving and simulating the two-dimensional heat conduction process was proposed. This method discretized the two-dimensional heat equation in time and space; then combined the modified Crank-Nicolson method with the alternating direction implicit method to obtain the discrete equations of each node; then the algebraic equations was solved and combined with the Richardson extrapolation method to improve the convergence speed of the calculation; Finally, the two-dimensional heat conduction process was simulated by computer graphics technology, and the dynamic visualization of the temperature field in the two-dimensional heat conduction region was realized. The method is second-order convergent both in time and space, and its order is increased from the second order to the fourth order when combined with the Richardson extrapolation method. Experiments showed that this method can stably realize the simulation and dynamic visualization the of two-dimensional heat conduction process.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"144 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116764295","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Design of an Automatic 3D Reconstruction Scanning System in Virtual Reality","authors":"Youxin Xie, Jingjing Zhang, Hai Huang","doi":"10.1109/ICVR57957.2023.10169806","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169806","url":null,"abstract":"Three-dimension reconstruction technology helps designers and developers convert virtual objects from the physical world. However, there are still methodological limitations in collecting scanned objects’ images, such as time-consuming work with lower accuracy by manual scan and the high cost of existing machine scanning. Therefore, this study proposes a new stereoscopic surround scanning system covering the target objects in quantity from multiple angles. Camera equipment (i.e., a mobile phone) with controlled poses is added above the system, and images from multi-directional perspectives are recorded. The 3D reconstruction algorithm only needs numerous images to reconstruct objects from 2D to 3D. Based on the 3D reconstruction algorithm, this research provided two comparative experiments and several methods to evaluate the benefit of the scanning machine. Besides, previous automatic scanners mainly cost hundreds to thousands of dollars, while the new scan station in this study was designed with less than 100${$}$ hardware budget. Accordingly, applying the whole system can improve the scanning method and reduce labour costs. This design of the scanning system brings new insights to promote the development of reconstruction technology in virtual reality applications.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-05-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121658065","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Optimal SVC Bitstream Schema for Viewport-Dependent 360-Degree Video Streaming","authors":"Gang Shen, Mingyang Ma, Guangxin Xu","doi":"10.1109/ICVR57957.2023.10169672","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169672","url":null,"abstract":"To deliver ultra-high resolution 360-degree video (such as 8K, 12K, or even higher) across the internet, viewport-dependent streaming becomes necessary to save bandwidth. During viewport switches, clients and servers will instantly exchange coordination info and contents for the given viewports. However, those viewport switches pose a serious challenge for video encoding because the temporal dependency between contents within changing viewports is unpredictable. In existing practices, it is commonly noted that GOP (Group of Pictures) size in a bitstream intrinsically prohibits the reduction of the viewport switch latency, such as Motion-to-photon (MTP) latency, or motion-to-high-quality (MTHQ) latency. In this paper, we presented a Scalable Video Coding (SVC) based bitstream schema, which can structurally remove the impacts of GOP in viewport-dependent streaming and provide instant viewport switches within one-frame time (the best possible). In addition, combined with tiling, this new coding schema allows an efficient packing of the non-adjacent regions within a viewport of 360-degree video. Our experiments also show that the overall encoding with this SVC-based approach is faster than with multi-stream approaches. Compared with current 360-degree video streaming solutions based on MPEG-I OMAF, our approach is superior in terms of viewport switch latency, simplicity of viewport packing, and encoding performance.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132871675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Analysis of Sampling Strategies for Implicit 3D Reconstruction","authors":"Qiang Liu, Xi Yang","doi":"10.1109/ICVR57957.2023.10169160","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169160","url":null,"abstract":"In the training process of the implicit 3D reconstruction network, the choice of spatial query points’ sampling strategy affects the final performance of the model. Different works have differences in the selection of sampling strategies, not only in the spatial distribution of query points but also in the order of magnitude difference in the density of query points. For how to select the sampling strategy of query points, current works are more akin to an enumerating operation to find the optimal solution, which seriously affects work efficiency. In this work, we explore the relationship between the sampling strategy and the final performance of the network through classification analysis and experimental comparison. We divide related works into three categories according to the similarities and differences of the network structure and the experimental results verify the rationality of our classification. Therefore, we carry out an in-depth discussion on the relationship between the network type and the sampling strategy. In addition, we also discuss the impact of sampling strategy on the model performance from the aspect of implicit function types. Finally, we discuss the important role of sampling density in balancing model performance and reducing experimental overhead.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"74 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121037401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"OSIS: Efficient One-Stage Network for 3D Instance Segmentation","authors":"Chuan Tang, Xi Yang","doi":"10.1109/ICVR57957.2023.10169430","DOIUrl":"https://doi.org/10.1109/ICVR57957.2023.10169430","url":null,"abstract":"Current 3D instance segmentation models generally use multi-stage methods to extract instance objects, including clustering, feature extraction, and post-processing processes. However, these multi-stage approaches rely on hyperparameter settings and hand-crafted processes, which restrict the inference speed of the model. In this paper, we propose a new 3D point cloud instance segmentation network, named OSIS. OSIS is a one-stage network, which directly segments instances from 3D point cloud data using neural network. To segment instances directly from the network, we propose an instance decoder, which decodes instance features from the network into instance segments. Our proposed OSIS realizes the end-to-end training by bipartite matching, therefore, our network does not require computationally expensive post-processing steps such as non maximum suppression (NMS) and clustering during inference. The results show that our network finally achieves excellent performance in the commonly used indoor scene instance segmentation dataset, and the inference speed of our network is only an average of 138ms per scene, which substantially exceeds the previous fastest method.","PeriodicalId":439483,"journal":{"name":"2023 9th International Conference on Virtual Reality (ICVR)","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128625704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}