Robotic Intelligence and Automation最新文献

{"title":"Graph neural network based abnormal perception information reconstruction and robust autonomous navigation","authors":"Zhiwei Zhang, Zhe Liu, Yanzi Miao, Xiaoping Ma","doi":"10.1108/ria-09-2023-0128","DOIUrl":"https://doi.org/10.1108/ria-09-2023-0128","url":null,"abstract":"Purpose\u0000This paper aims to develop a robust navigation enhancement framework to handle one of the most urgent needs for real applications of autonomous vehicles nowadays, as these corner cases act as the most commonly occurred risks in potential self-driving accidents.\u0000\u0000Design/methodology/approach\u0000In this paper, the main idea is to fully exploit the consistent features among spatio-temporal data and thus detect the anomalies and build residual channels to reconstruct the abnormal information. The authors first develop an anomaly detection algorithm, then followed by a corresponding disturbed information reconstruction network which has strong robustness to address both the nature disturbances and external attacks. Finally, the authors introduce a fully end-to-end resilient navigation performance enhancement framework to improve the driving performance of existing self-driving models under attacks and disturbances.\u0000\u0000Findings\u0000Comparison results on CARLA platform and real experiments demonstrate strong resilience of the authors’ approach which enhances the navigation performance under disturbances and attacks.\u0000\u0000Originality/value\u0000Reliable and resilient navigation performance under various nature disturbances and even external attacks is one of the most urgent needs for real applications of autonomous vehicles nowadays, as these corner cases act as the most commonly occurred risks in potential self-driving accidents. The information reconstruction approach provides a resilient navigation performance enhancement method for existing self-driving models.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"54 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141098070","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Design and implementation of an AI-controlled spraying drone for agricultural applications using advanced image preprocessing techniques","authors":"Cemalettin Akdoğan, Tolga Özer, Y. Oğuz","doi":"10.1108/ria-05-2023-0068","DOIUrl":"https://doi.org/10.1108/ria-05-2023-0068","url":null,"abstract":"\u0000Purpose\u0000Nowadays, food problems are likely to arise because of the increasing global population and decreasing arable land. Therefore, it is necessary to increase the yield of agricultural products. Pesticides can be used to improve agricultural land products. This study aims to make the spraying of cherry trees more effective and efficient with the designed artificial intelligence (AI)-based agricultural unmanned aerial vehicle (UAV).\u0000\u0000\u0000Design/methodology/approach\u0000Two approaches have been adopted for the AI-based detection of cherry trees: In approach 1, YOLOv5, YOLOv7 and YOLOv8 models are trained with 70, 100 and 150 epochs. In Approach 2, a new method is proposed to improve the performance metrics obtained in Approach 1. Gaussian, wavelet transform (WT) and Histogram Equalization (HE) preprocessing techniques were applied to the generated data set in Approach 2. The best-performing models in Approach 1 and Approach 2 were used in the real-time test application with the developed agricultural UAV.\u0000\u0000\u0000Findings\u0000In Approach 1, the best F1 score was 98% in 100 epochs with the YOLOv5s model. In Approach 2, the best F1 score and mAP values were obtained as 98.6% and 98.9% in 150 epochs, with the YOLOv5m model with an improvement of 0.6% in the F1 score. In real-time tests, the AI-based spraying drone system detected and sprayed cherry trees with an accuracy of 66% in Approach 1 and 77% in Approach 2. It was revealed that the use of pesticides could be reduced by 53% and the energy consumption of the spraying system by 47%.\u0000\u0000\u0000Originality/value\u0000An original data set was created by designing an agricultural drone to detect and spray cherry trees using AI. YOLOv5, YOLOv7 and YOLOv8 models were used to detect and classify cherry trees. The results of the performance metrics of the models are compared. In Approach 2, a method including HE, Gaussian and WT is proposed, and the performance metrics are improved. The effect of the proposed method in a real-time experimental application is thoroughly analyzed.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"56 11","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140230333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Robot skill learning and the data dilemma it faces: a systematic review","authors":"Rong Jiang, Bin He, Zhipeng Wang, Xu Cheng, Hongrui Sang, Yanmin Zhou","doi":"10.1108/ria-10-2023-0146","DOIUrl":"https://doi.org/10.1108/ria-10-2023-0146","url":null,"abstract":"\u0000Purpose\u0000Compared with traditional methods relying on manual teaching or system modeling, data-driven learning methods, such as deep reinforcement learning and imitation learning, show more promising potential to cope with the challenges brought by increasingly complex tasks and environments, which have become the hot research topic in the field of robot skill learning. However, the contradiction between the difficulty of collecting robot–environment interaction data and the low data efficiency causes all these methods to face a serious data dilemma, which has become one of the key issues restricting their development. Therefore, this paper aims to comprehensively sort out and analyze the cause and solutions for the data dilemma in robot skill learning.\u0000\u0000\u0000Design/methodology/approach\u0000First, this review analyzes the causes of the data dilemma based on the classification and comparison of data-driven methods for robot skill learning; Then, the existing methods used to solve the data dilemma are introduced in detail. Finally, this review discusses the remaining open challenges and promising research topics for solving the data dilemma in the future.\u0000\u0000\u0000Findings\u0000This review shows that simulation–reality combination, state representation learning and knowledge sharing are crucial for overcoming the data dilemma of robot skill learning.\u0000\u0000\u0000Originality/value\u0000To the best of the authors’ knowledge, there are no surveys that systematically and comprehensively sort out and analyze the data dilemma in robot skill learning in the existing literature. It is hoped that this review can be helpful to better address the data dilemma in robot skill learning in the future.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"232 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140247388","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Obstacle detection and obstacle-surmounting planning for a wheel-legged robot based on Lidar","authors":"Ruoxing Wang, Shoukun Wang, Junfeng Xue, Zhihua Chen, Jinge Si","doi":"10.1108/ria-12-2022-0275","DOIUrl":"https://doi.org/10.1108/ria-12-2022-0275","url":null,"abstract":"\u0000Purpose\u0000This paper aims to investigate an autonomous obstacle-surmounting method based on a hybrid gait for the problem of crossing low-height obstacles autonomously by a six wheel-legged robot. The autonomy of obstacle-surmounting is reflected in obstacle recognition based on multi-frame point cloud fusion.\u0000\u0000\u0000Design/methodology/approach\u0000In this paper, first, for the problem that the lidar on the robot cannot scan the point cloud of low-height obstacles, the lidar is driven to rotate by a 2D turntable to obtain the point cloud of low-height obstacles under the robot. Tightly-coupled Lidar Inertial Odometry via Smoothing and Mapping algorithm, fast ground segmentation algorithm and Euclidean clustering algorithm are used to recognize the point cloud of low-height obstacles and obtain low-height obstacle in-formation. Then, combined with the structural characteristics of the robot, the obstacle-surmounting action planning is carried out for two types of obstacle scenes. A segmented approach is used for action planning. Gait units are designed to describe each segment of the action. A gait matrix is used to describe the overall action. The paper also analyzes the stability and surmounting capability of the robot’s key pose and determines the robot’s surmounting capability and the value scheme of the surmounting control variables.\u0000\u0000\u0000Findings\u0000The experimental verification is carried out on the robot laboratory platform (BIT-6NAZA). The obstacle recognition method can accurately detect low-height obstacles. The robot can maintain a smooth posture to cross low-height obstacles, which verifies the feasibility of the adaptive obstacle-surmounting method.\u0000\u0000\u0000Originality/value\u0000The study can provide the theory and engineering foundation for the environmental perception of the unmanned platform. It provides environmental information to support follow-up work, for example, on the planning of obstacles and obstacles.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"2 7","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140261001","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Application of fuzzy logic in multi-sensor-based health service robot for condition monitoring during pandemic situations","authors":"A. Rout, G. B. Mahanta, B. Biswal, Renin Francy T., Sri Vardhan Raj, Deepak B.B.V.L.","doi":"10.1108/ria-07-2023-0091","DOIUrl":"https://doi.org/10.1108/ria-07-2023-0091","url":null,"abstract":"\u0000Purpose\u0000The purpose of this study is to plan and develop a cost-effective health-care robot for assisting and observing the patients in an accurate and effective way during pandemic situation like COVID-19. The purposed research work can help in better management of pandemic situations in rural areas as well as developing countries where medical facility is not easily available.\u0000\u0000\u0000Design/methodology/approach\u0000It becomes very difficult for the medical staff to have a continuous check on patient’s condition in terms of symptoms and critical parameters during pandemic situations. For dealing with these situations, a service mobile robot with multiple sensors for measuring patients bodily indicators has been proposed and the prototype for the same has been developed that can monitor and aid the patient using the robotic arm. The fuzzy controller has also been incorporated with the mobile robot through which decisions on patient monitoring can be taken automatically. Mamdani implication method has been utilized for formulating mathematical expression of M number of “if and then condition based rules” with defined input Xj (j = 1, 2, ………. s), and output yi. The inputs and output variables are formed by the membership functions µAij(xj) and µCi(yi) to execute the Fuzzy Inference System controller. Here, Aij and Ci are the developed fuzzy sets.\u0000\u0000\u0000Findings\u0000The fuzzy-based prediction model has been tested with the output of medicines for the initial 27 runs and was validated by the correlation of predicted and actual values. The correlation coefficient has been found to be 0.989 with a mean square error value of 0.000174, signifying a strong relationship between the predicted values and the actual values. The proposed research work can handle multiple tasks like online consulting, continuous patient condition monitoring in general wards and ICUs, telemedicine services, hospital waste disposal and providing service to patients at regular time intervals.\u0000\u0000\u0000Originality/value\u0000The novelty of the proposed research work lies in the integration of artificial intelligence techniques like fuzzy logic with the multi-sensor-based service robot for easy decision-making and continuous patient monitoring in hospitals in rural areas and to reduce the work stress on medical staff during pandemic situation.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"14 52","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140442615","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Human-robot collaborative task planning for assembly system productivity enhancement","authors":"Anil Kumar Inkulu, M.V.A. Raju Bahubalendruni","doi":"10.1108/ria-05-2023-0067","DOIUrl":"https://doi.org/10.1108/ria-05-2023-0067","url":null,"abstract":"\u0000Purpose\u0000In the current era of Industry 4.0, the manufacturing industries are striving toward mass production with mass customization by considering human–robot collaboration. This study aims to propose the reconfiguration of assembly systems by incorporating multiple humans with robots using a human–robot task allocation (HRTA) to enhance productivity.\u0000\u0000\u0000Design/methodology/approach\u0000A human–robot task scheduling approach has been developed by considering task suitability, resource availability and resource selection through multicriteria optimization using the Linear Regression with Optimal Point and Minimum Distance Calculation algorithm. Using line-balancing techniques, the approach estimates the optimum number of resources required for assembly tasks operating by minimum idle time.\u0000\u0000\u0000Findings\u0000The task allocation schedule for a case study involving a punching press was solved using human–robot collaboration, and the approach incorporated the optimum number of appropriate resources to handle different types of proportion of resources.\u0000\u0000\u0000Originality/value\u0000This proposed work integrates the task allocation by human–robot collaboration and decrease the idle time of resource by integrating optimum number of resources.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"59 46","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139598656","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"AEKF-based trajectory-error compensation of knee exoskeleton for human–exoskeleton interaction control","authors":"Yuepeng Zhang, Guangzhong Cao, Linglong Li, Dongfeng Diao","doi":"10.1108/ria-04-2023-0058","DOIUrl":"https://doi.org/10.1108/ria-04-2023-0058","url":null,"abstract":"\u0000Purpose\u0000The purpose of this paper is to design a new trajectory error compensation method to improve the trajectory tracking performance and compliance of the knee exoskeleton in human–exoskeleton interaction motion.\u0000\u0000\u0000Design/methodology/approach\u0000A trajectory error compensation method based on admittance-extended Kalman filter (AEKF) error fusion for human–exoskeleton interaction control. The admittance controller is used to calculate the trajectory error adjustment through the feedback human–exoskeleton interaction force, and the actual trajectory error is obtained through the encoder feedback of exoskeleton and the designed trajectory. By using the fusion and prediction characteristics of EKF, the calculated trajectory error adjustment and the actual error are fused to obtain a new trajectory error compensation, which is feedback to the knee exoskeleton controller. This method is designed to be capable of improving the trajectory tracking performance of the knee exoskeleton and enhancing the compliance of knee exoskeleton interaction.\u0000\u0000\u0000Findings\u0000Six volunteers conducted comparative experiments on four different motion frequencies. The experimental results show that this method can effectively improve the trajectory tracking performance and compliance of the knee exoskeleton in human–exoskeleton interaction.\u0000\u0000\u0000Originality/value\u0000The AEKF method first uses the data fusion idea to fuse the estimated error with measurement errors, obtaining more accurate trajectory error compensation for the knee exoskeleton motion control. This work provides great benefits for the trajectory tracking performance and compliance of lower limb exoskeletons in human–exoskeleton interaction movements.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"7 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139438440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"A risk-aware reference trajectory resampling method for quadrotor tracking accuracy improvement","authors":"Kaizheng Zhang, Jian Di, Jiulong Wang, Xinghu Wang, Haibo Ji","doi":"10.1108/ria-10-2023-0151","DOIUrl":"https://doi.org/10.1108/ria-10-2023-0151","url":null,"abstract":"\u0000Purpose\u0000Many existing trajectory optimization algorithms use parameters like maximum velocity or acceleration to formulate constraints. Due to the ignoring of the quadrotor actual tracking capability, the generated trajectories may not be suitable for tracking control. The purpose of this paper is to design an online adjustment algorithm to improve the overall quadrotor trajectory tracking performance.\u0000\u0000\u0000Design/methodology/approach\u0000The authors propose a reference trajectory resampling layer (RTRL) to dynamically adjust the reference signals according to the current tracking status and future tracking risks. First, the authors design a risk-aware tracking monitor that uses the Frenét tracking errors and the curvature and torsion of the reference trajectory to evaluate tracking risks. Then, the authors propose an online adjusting algorithm by using the time scaling method.\u0000\u0000\u0000Findings\u0000The proposed RTRL is shown to be effective in improving the quadrotor trajectory tracking accuracy by both simulation and experiment results.\u0000\u0000\u0000Originality/value\u0000Infeasible reference trajectories may cause serious accidents for autonomous quadrotors. The results of this paper can improve the safety of autonomous quadrotor in application.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"53 12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139442070","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Collaborative algorithm of workpiece scheduling and AGV operation in flexible workshop","authors":"Wenlong Cheng, Wenjun Meng","doi":"10.1108/ria-11-2022-0266","DOIUrl":"https://doi.org/10.1108/ria-11-2022-0266","url":null,"abstract":"\u0000Purpose\u0000This study aims to solve the problem of job scheduling and multi automated guided vehicle (AGV) cooperation in intelligent manufacturing workshops.\u0000\u0000\u0000Design/methodology/approach\u0000In this study, an algorithm for job scheduling and cooperative work of multiple AGVs is designed. In the first part, with the goal of minimizing the total processing time and the total power consumption, the niche multi-objective evolutionary algorithm is used to determine the processing task arrangement on different machines. In the second part, AGV is called to transport workpieces, and an improved ant colony algorithm is used to generate the initial path of AGV. In the third part, to avoid path conflicts between running AGVs, the authors propose a simple priority-based waiting strategy to avoid collisions.\u0000\u0000\u0000Findings\u0000The experiment shows that the solution can effectively deal with job scheduling and multiple AGV operation problems in the workshop.\u0000\u0000\u0000Originality/value\u0000In this paper, a collaborative work algorithm is proposed, which combines the job scheduling and AGV running problem to make the research results adapt to the real job environment in the workshop.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"43 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139390582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"MCFilter: feature filter based on motion-correlation for LiDAR SLAM","authors":"Han Sun, Song Tang, Xiaozhi Qi, Zhiyuan Ma, Jianxin Gao","doi":"10.1108/ria-07-2023-0086","DOIUrl":"https://doi.org/10.1108/ria-07-2023-0086","url":null,"abstract":"\u0000Purpose\u0000This study aims to introduce a novel noise filter module designed for LiDAR simultaneous localization and mapping (SLAM) systems. The primary objective is to enhance pose estimation accuracy and improve the overall system performance in outdoor environments.\u0000\u0000\u0000Design/methodology/approach\u0000Distinct from traditional approaches, MCFilter emphasizes enhancing point cloud data quality at the pixel level. This framework hinges on two primary elements. First, the D-Tracker, a tracking algorithm, is grounded on multiresolution three-dimensional (3D) descriptors and adeptly maintains a balance between precision and efficiency. Second, the R-Filter introduces a pixel-level attribute named motion-correlation, which effectively identifies and removes dynamic points. Furthermore, designed as a modular component, MCFilter ensures seamless integration into existing LiDAR SLAM systems.\u0000\u0000\u0000Findings\u0000Based on rigorous testing with public data sets and real-world conditions, the MCFilter reported an increase in average accuracy of 12.39% and reduced processing time by 24.18%. These outcomes emphasize the method’s effectiveness in refining the performance of current LiDAR SLAM systems.\u0000\u0000\u0000Originality/value\u0000In this study, the authors present a novel 3D descriptor tracker designed for consistent feature point matching across successive frames. The authors also propose an innovative attribute to detect and eliminate noise points. Experimental results demonstrate that integrating this method into existing LiDAR SLAM systems yields state-of-the-art performance.\u0000","PeriodicalId":501194,"journal":{"name":"Robotic Intelligence and Automation","volume":"18 12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138589467","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}