Robotic Intelligence and Automation最新文献

{"title":"Immersive innovations: an examination of the efficacy and evolution of virtual reality in human movement training","authors":"Yi Deng, Zhiguo Wang, Lin Dong, Yu Lei, Yanling Dong","doi":"10.1108/ria-05-2023-0072","DOIUrl":"https://doi.org/10.1108/ria-05-2023-0072","url":null,"abstract":"\u0000Purpose\u0000This systematic review, following preferred reporting items for systematic reviews and meta-analysis guidelines, rigorously investigates the emergent role of virtual reality (VR) technology in human movement training. The purpose of this study is to explore the effectiveness and evolution of VR in enhancing movement training experiences.\u0000\u0000\u0000Design/methodology/approach\u0000Acknowledging its pivotal role in diverse applications, such as sports and rehabilitation, human movement training is currently experiencing accelerated evolution, facilitated by the proliferation of wearable devices and mobile applications. This review conducted an exhaustive search across five different electronic databases, such as Web of Science, PubMed and ProQuest, resulting in the selection of 69 eligible articles published within the past five years. It also integrates 40 studies into a narrative summary, categorized based on the level of immersion offered by respective VR systems.\u0000\u0000\u0000Findings\u0000Enhanced immersion in VR potentially augments the effectiveness of movement training by engendering more realistic and captivating experiences for users. The immersive and interactive environments provided by VR technology enable tailored training experiences accompanied by precise, objective feedback. This review highlights the benefits of VR in human movement training and its potential to revolutionize the way training is conducted.\u0000\u0000\u0000Originality/value\u0000This systematic review contributes significantly to the existing literature by providing a comprehensive examination of the efficacy and evolution of VR in human movement training. By organizing the findings based on the level of immersion offered by VR systems, it provides valuable insights into the importance of immersion in enhancing training outcomes. In addition, this study identifies the need for future research focusing on the impacts of VR on learning and performance, as well as strategies to optimize its effectiveness and improve accessibility.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134636731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Multi-robot raster map fusion without initial relative position","authors":"Minghao Wang, M. Cong, Yuqing Du, Dong Liu, Xiaojing Tian","doi":"10.1108/ria-04-2022-0095","DOIUrl":"https://doi.org/10.1108/ria-04-2022-0095","url":null,"abstract":"\u0000Purpose\u0000The purpose of this study is to solve the problem of an unknown initial position in a multi-robot raster map fusion. The method includes two-dimensional (2D) raster maps and three-dimensional (3D) point cloud maps.\u0000\u0000\u0000Design/methodology/approach\u0000A fusion method using multiple algorithms was proposed. For 2D raster maps, this method uses accelerated robust feature detection to extract feature points of multi-raster maps, and then feature points are matched using a two-step algorithm of minimum Euclidean distance and adjacent feature relation. Finally, the random sample consensus algorithm was used for redundant feature fusion. On the basis of 2D raster map fusion, the method of coordinate alignment is used for 3D point cloud map fusion.\u0000\u0000\u0000Findings\u0000To verify the effectiveness of the algorithm, the segmentation mapping method (2D raster map) and the actual robot mapping method (2D raster map and 3D point cloud map) were used for experimental verification. The experiments demonstrated the stability and reliability of the proposed algorithm.\u0000\u0000\u0000Originality/value\u0000This algorithm uses a new visual method with coordinate alignment to process the raster map, which can effectively solve the problem of the demand for the initial relative position of robots in traditional methods and be more adaptable to the fusion of 3D maps. In addition, the original data of the map can come from different types of robots, which greatly improves the universality of the algorithm.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"48 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124698471","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Manual assembly actions segmentation system using temporal-spatial-contact features","authors":"Zengxin Kang, Jing Cui, Zhongyi Chu","doi":"10.1108/ria-01-2023-0008","DOIUrl":"https://doi.org/10.1108/ria-01-2023-0008","url":null,"abstract":"\u0000Purpose\u0000Accurate segmentation of artificial assembly action is the basis of autonomous industrial assembly robots. This paper aims to study the precise segmentation method of manual assembly action.\u0000\u0000\u0000Design/methodology/approach\u0000In this paper, a temporal-spatial-contact features segmentation system (TSCFSS) for manual assembly actions recognition and segmentation is proposed. The system consists of three stages: spatial features extraction, contact force features extraction and action segmentation in the temporal dimension. In the spatial features extraction stage, a vectors assembly graph (VAG) is proposed to precisely describe the motion state of the objects and relative position between objects in an RGB-D video frame. Then graph networks are used to extract the spatial features from the VAG. In the contact features extraction stage, a sliding window is used to cut contact force features between hands and tools/parts corresponding to the video frame. Finally, in the action segmentation stage, the spatial and contact features are concatenated as the input of temporal convolution networks for action recognition and segmentation. The experiments have been conducted on a new manual assembly data set containing RGB-D video and contact force.\u0000\u0000\u0000Findings\u0000In the experiments, the TSCFSS is used to recognize 11 kinds of assembly actions in demonstrations and outperforms the other comparative action identification methods.\u0000\u0000\u0000Originality/value\u0000A novel manual assembly actions precisely segmentation system, which fuses temporal features, spatial features and contact force features, has been proposed. The VAG, a symbolic knowledge representation for describing assembly scene state, is proposed, making action segmentation more convenient. A data set with RGB-D video and contact force is specifically tailored for researching manual assembly actions.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133397918","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"An efficient genetic algorithm for multi AGV scheduling problem about intelligent warehouse","authors":"Wenlong Cheng, W. Meng","doi":"10.1108/ria-10-2022-0258","DOIUrl":"https://doi.org/10.1108/ria-10-2022-0258","url":null,"abstract":"\u0000Purpose\u0000This study aims to address the challenge of automatic guided vehicle (AGV) scheduling for parcel storage and retrieval in an intelligent warehouse.\u0000\u0000\u0000Design/methodology/approach\u0000This study presents a scheduling solution that aims to minimize the maximum completion time for the AGV scheduling problem in an intelligent warehouse. First, a mixed-integer linear programming model is established, followed by the proposal of a novel genetic algorithm to solve the scheduling problem of multiple AGVs. The improved algorithm includes operations such as the initial population optimization of picking up goods based on the principle of the nearest distance, adaptive crossover operation evolving with iteration, mutation operation of equivalent exchange and an algorithm restart strategy to expand search ability and avoid falling into a local optimal solution. Moreover, the routing rules of AGV are described.\u0000\u0000\u0000Findings\u0000By conducting a series of comparative experiments based on the actual package flow situation of an intelligent warehouse, the results demonstrate that the proposed genetic algorithm in this study outperforms existing algorithms, and can produce better solutions for the AGV scheduling problem.\u0000\u0000\u0000Originality/value\u0000This paper optimizes the different iterative steps of the genetic algorithm and designs an improved genetic algorithm, which is more suitable for solving the AGV scheduling problem in the warehouse. In addition, a path collision avoidance strategy that matches the algorithm is proposed, making this research more applicable to real-world scheduling environments.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"7 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125052302","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"On mimicking human’s manipulation for robot-assisted spine ultrasound imaging","authors":"Qinghua Huang, Yingchen Wang, Hao Luo, Jianyi Li","doi":"10.1108/ria-02-2023-0012","DOIUrl":"https://doi.org/10.1108/ria-02-2023-0012","url":null,"abstract":"\u0000Purpose\u0000This paper aims to develop a new robotic ultrasound system for spine imaging with more anthropomorphic scanning manipulation in comparison with previously reported techniques.\u0000\u0000\u0000Design/methodology/approach\u0000The system evaluates the imaging quality of ultrasound (US) B-scans by detecting vertebral landmarks and groups the images with relatively low quality into several sub-optimal types. By imitating the scanning skills of sonographers, the authors defined a set of adjustment strategies for certain sub-optimal types. In this way, the robot can recollect the US images with high quality by adaptively adjusting the pose of the probe like a sonographer.\u0000\u0000\u0000Findings\u0000The results from phantom experiments and in vivo experiments showed that the proposed method could improve the quality of B-scans during the scanning. The 3 D US volume reconstruction has also verified the feasibility of the proposed method.\u0000\u0000\u0000Originality/value\u0000This paper demonstrates how to adapt a robotic spinal ultrasound scanning using a preliminary anthropomorphic approach.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121907220","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Robot task programming in complex task scenarios based on spatio-temporal constraint calculus","authors":"Jinzhong Li, M. Cong, Dong Liu, Yuqing Du","doi":"10.1108/ria-03-2023-0020","DOIUrl":"https://doi.org/10.1108/ria-03-2023-0020","url":null,"abstract":"\u0000Purpose\u0000Robots face fundamental challenges in achieving reliable and stable operations for complex home service scenarios. This is one of the crucial topics of robotics methods to imitate human beings’ advanced cognitive characteristics and apply them to solve complex tasks. The purpose of this study is to enable robots to have the ability to understand the scene and task process in complex scenes and to provide a reference method for robot task programming in complex scenes.\u0000\u0000\u0000Design/methodology/approach\u0000This paper constructs a task modeling method for robots in complex environments based on the characteristics of the perception-motor memory model of human cognition. In the aspect of episodic memory construction, the task execution process is included in the category of qualitative spatio-temporal calculus. The topology interaction of objects in a task scenario is used to define scene attributes. The task process can be regarded as changing scene attributes on a time scale. The qualitative spatio-temporal activity graphs are used to analyze the change process of the object state with time during the robot task execution. The tasks are divided according to the different values of scene attributes at different times during task execution. Based on this, in procedural memory, an object-centered motion model is developed by analyzing the changes in the relationship between objects in the scene episode by analyzing the scene changes before and after the robot performs the actions. Finally, the task execution process of the robot is constructed by alternately reconstructing episodic memory and procedural memory.\u0000\u0000\u0000Findings\u0000To verify the applicability of the proposed model, a scenario where the robot combines the object (one of the most common tasks in-home service) is set up. The proposed method can obtain the landscape of robot tasks in a complex environment.\u0000\u0000\u0000Originality/value\u0000The robot can achieve high-level task programming through the alternating interpretation of scenarios and actions. The proposed model differs from traditional methods based on geometric or physical feature information. However, it focuses on the spatial relationship of objects, which is more similar to the cognitive mechanism of human understanding of the environment.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"57 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131600392","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Surface defect classification of hot-rolled steel strip based on mixed attention mechanism","authors":"Haonan Fan, Qin Dong, Naixuan Guo","doi":"10.1108/ria-01-2023-0001","DOIUrl":"https://doi.org/10.1108/ria-01-2023-0001","url":null,"abstract":"\u0000Purpose\u0000This paper aims to propose a classification method for steel strip surface defects based on a mixed attention mechanism to achieve fast and accurate classification performance. The traditional method of classifying surface defects of hot-rolled steel strips has the problems of low recognition accuracy and low efficiency in the industrial complex production environment.\u0000\u0000\u0000Design/methodology/approach\u0000The authors selected min–max scaling comparison method to filter the training results of multiple network models on the steel strip surface defect data set. Then, the best comprehensive performance model EfficientNet-B0 was refined. Based on this, the authors proposed two mixed attention addition methods, which include squeeze-excitation spatial mixed module and multilayer mixed attention mechanism (MMAM) module, respectively.\u0000\u0000\u0000Findings\u0000With these two methods, the authors achieved 96.72% and 97.70% recognition accuracy on the steel strip data set after data augmentation for adapting to the complex production environment, respectively. Using the transfer learning method, the EfficientNet-B0 based on MMAM obtained 100% recognition accuracy.\u0000\u0000\u0000Originality/value\u0000This study not only focuses on improving the recognition accuracy of the network model itself but also considers other performance indicators of the network, which are rarely considered by many researchers. The authors further improve the intelligent production technique and address this issue. Both methods proposed in this paper can be applied to embedded equipment, which can effectively improve steel strip factory production efficiency and reduce material and time loss.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114964716","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Study of speed and angle during safe and comfortable standing of elderly people","authors":"Haiyan Wang, Jiayu Fu, Li Mei, Xiangrong Xu, Shanshan Xu, Zhixiong Wang, R. S. Na","doi":"10.1108/ria-09-2022-0227","DOIUrl":"https://doi.org/10.1108/ria-09-2022-0227","url":null,"abstract":"\u0000Purpose\u0000This study aims to obtain the speed and angle during safe and comfortable standing of elderly people. With the advancement of society, it is becoming increasingly difficult for the elderly to sit-to-stand (STS) independently and comfortably in a safe and comfortable manner. Safety is essentially a prerequisite for the elderly to achieve a comfortable STS. The speed, angle and power of the STS process can all affect safe STS. From the standpoint of health-care delivery and administration, comfortable STS can be realized easily by addressing the safety issues during STS.\u0000\u0000\u0000Design/methodology/approach\u0000This paper summarizes the research progress on speed and angle during safe and comfortable standing of older people. The authors analyzed the speed and angle of the STS using the Vicon optical gait acquisition system and plantar pressure sensor to find the appropriate angle and speed thresholds.\u0000\u0000\u0000Findings\u0000The center of gravity movement is a prerequisite for the elderly to achieve a comfortable STS. The authors found that the standing speed during the STS process should not be higher than 103.8 mm/s so that the elderly can stand comfortably and safely (safe and dangerous speeds are 72.8 mm/s and 125.2 mm/s). The limitations of waist angle, waist angle speed and the acceleration are also obtained.\u0000\u0000\u0000Originality/value\u0000This paper analyzes and summarizes the research status of speed and angle during safe and comfortable standing of elderly people, which is essentially a prerequisite for the elderly to achieve a comfortable STS. These results can lay the foundation for the development of assistive devices and related technologies that meet the needs of older adults.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131844679","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Boosting visual servoing performance through RGB-based methods","authors":"Haolin Fei, Ziwei Wang, Stefano Tedeschi, Andrew Kennedy","doi":"10.1108/ria-04-2023-0049","DOIUrl":"https://doi.org/10.1108/ria-04-2023-0049","url":null,"abstract":"\u0000Purpose\u0000This paper aims to evaluate and compare the performance of different computer vision algorithms in the context of visual servoing for augmented robot perception and autonomy.\u0000\u0000\u0000Design/methodology/approach\u0000The authors evaluated and compared three different approaches: a feature-based approach, a hybrid approach and a machine-learning-based approach. To evaluate the performance of the approaches, experiments were conducted in a simulated environment using the PyBullet physics simulator. The experiments included different levels of complexity, including different numbers of distractors, varying lighting conditions and highly varied object geometry.\u0000\u0000\u0000Findings\u0000The experimental results showed that the machine-learning-based approach outperformed the other two approaches in terms of accuracy and robustness. The approach could detect and locate objects in complex scenes with high accuracy, even in the presence of distractors and varying lighting conditions. The hybrid approach showed promising results but was less robust to changes in lighting and object appearance. The feature-based approach performed well in simple scenes but struggled in more complex ones.\u0000\u0000\u0000Originality/value\u0000This paper sheds light on the superiority of a hybrid algorithm that incorporates a deep neural network in a feature detector for image-based visual servoing, which demonstrates stronger robustness in object detection and location against distractors and lighting conditions.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128618792","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Robust pose estimation for ship block assembly feature based on large-scale scanning","authors":"Chuyu Tang, Genliang Chen, Hao Wang, Y. Yu","doi":"10.1108/ria-09-2022-0239","DOIUrl":"https://doi.org/10.1108/ria-09-2022-0239","url":null,"abstract":"\u0000Purpose\u0000Hull block assembly is a vital task in ship construction. It is necessary to obtain the actual poses of the assembly features to guide further block alignment. Traditional methods use single-point measurement, which is time-consuming and may lead to loss of key information. Thus, large-scale scanning is introduced for data acquisition, and this paper aims to provide a precise and robust method for retrieving poses based on point set registration.\u0000\u0000\u0000Design/methodology/approach\u0000The main problem of point registration is to find the correct transformation between the model and the scene. In this paper, a vote framework based on a new point pair feature is used to calculate the transformation. First, a special edge indicator for multiplate objects is proposed to determine the edges. Subsequently, pair features with an edge description are noted for every point. Finally, a voting scheme based on agglomerative clustering is implemented to determine the optimal transformation.\u0000\u0000\u0000Findings\u0000The proposed method not only improves registration efficiency but also maintains high accuracy compared to several commonly used approaches. In particular, for objects composed of plates, the results of pose estimation are more promising because of the compact pair feature. The multiple ship longitudinal localization experiment validates the effectiveness in real scan applications.\u0000\u0000\u0000Originality/value\u0000The proposed edge description performs a better detection for the edges of multiplate objects. The pair feature incorporating the edge indicator is more discriminative than the original template, resulting in better robustness to outliers, noise and occlusions.\u0000","PeriodicalId":379181,"journal":{"name":"Robotic Intelligence and Automation","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128439687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}