{"title":"Efficient learning of robust quadruped bounding using pretrained neural networks","authors":"Zhicheng Wang, Anqiao Li, Yixiao Zheng, Anhuan Xie, Zhibin Li, Jun Wu, Qiuguo Zhu","doi":"10.1049/csy2.12062","DOIUrl":"10.1049/csy2.12062","url":null,"abstract":"<p>Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body movements. The authors first pretrained the neural network (NN) based on data from a robot operated by conventional model-based controllers, and then further optimised the pretrained NN via deep reinforcement learning (DRL). In particular, the authors designed a reward function considering contact points and phases to enforce the gait symmetry and periodicity, which improved the bounding performance. The NN-based feedback controller was learned in the simulation and directly deployed on the real quadruped robot Jueying Mini successfully. A variety of environments are presented both indoors and outdoors with the authors’ approach. The authors’ approach shows efficient computing and good locomotion results by the Jueying Mini quadrupedal robot bounding over uneven terrain.</p><p>The cover image is based on the Research Article <i>Efficient learning of robust quadruped bounding using pretrained neural networks</i> by Zhicheng Wang et al., https://doi.org/10.1049/csy2.12062.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 4","pages":"331-338"},"PeriodicalIF":0.0,"publicationDate":"2022-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12062","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46689991","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A trajectory summarisation generation method based on the mobile robot behaviour analysis","authors":"Weifeng Liu, Liwen Ma, Shaoyong Qu, Zhangming Peng","doi":"10.1049/csy2.12063","DOIUrl":"10.1049/csy2.12063","url":null,"abstract":"<p>The semantic representation of the trajectory is conducive to enrich the content of trajectory data mining. A trajectory summarisation generation method based on the mobile robot behaviour analysis was proposed to realize the abstract expression and semantic representation of the spatio-temporal motion features of the robot and its environmental interaction state. First, the behavioural semantic modelling and representation of the mobile robot are completed by modelling the sub-trajectory and calculating the topological behaviour (TOP). Second, Chinese word segmentation and semantic slot filling methods are used to combine with hierarchical clustering to perform basic word extraction and classification for describing trajectory sentences. Then, the description language frame is extracted based on the TOP, and the final trajectory summarisation is generated. The result shows that the proposed method can semantically represent robot behaviours with different motion features and topological features, extract two verb-frameworks for describing the sentences according to their topological features, and dynamically adjust the syntactic structure for the different topological behaviours between the target and the environment. The proposed method can generate semantic information of relatively high quality for spatio-temporal data and help to understand the higher-order semantics of moving robot behaviour.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"5 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12063","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42549546","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A new noise network and gradient parallelisation-based asynchronous advantage actor-critic algorithm","authors":"Zhengshun Fei, Yanping Wang, Jinglong Wang, Kangling Liu, Bingqiang Huang, Ping Tan","doi":"10.1049/csy2.12059","DOIUrl":"10.1049/csy2.12059","url":null,"abstract":"<p>Asynchronous advantage actor-critic (A3C) algorithm is a commonly used policy optimization algorithm in reinforcement learning, in which asynchronous is parallel interactive sampling and training, and advantage is a sampling multi-step reward estimation method for computing weights. In order to address the problem of low efficiency and insufficient convergence caused by the traditional heuristic exploration of A3C algorithm in reinforcement learning, an improved A3C algorithm is proposed in this paper. In this algorithm, a noise network function, which updates the noise tensor in an explicit way is constructed to train the agent. Generalised advantage estimation (GAE) is also adopted to describe the dominance function. Finally, a new mean gradient parallelisation method is designed to update the parameters in both the primary and secondary networks by summing and averaging the gradients passed from all the sub-processes to the main process. Simulation experiments were conducted in a gym environment using the PyTorch Agent Net (PTAN) advanced reinforcement learning library, and the results show that the method enables the agent to complete the learning training faster and its convergence during the training process is better. The improved A3C algorithm has a better performance than the original algorithm, which can provide new ideas for subsequent research on reinforcement learning algorithms.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 3","pages":"175-188"},"PeriodicalIF":0.0,"publicationDate":"2022-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12059","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47988721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A heuristic control framework for heavy-duty hexapod robot over complex terrain","authors":"Jinmian Hou, Hui Chai, Yibin Li, Yaxian Xin, Wei Chen","doi":"10.1049/csy2.12064","DOIUrl":"10.1049/csy2.12064","url":null,"abstract":"<p>The large and heavy-duty hexapod robot has strong motion stability and load capacity, which promises to have a wide range of application prospects in rescue and disaster relief. Multi-mode gait and static stability during walking make the hexapod robot adapt to more diverse terrains, while little research has been conducted on the motion control methods of heavy-duty hexapod robots in complex environments. A novel heuristic whole-body motion control framework for the heavy-duty hexapod robot to traverse complex terrain is presented. By splitting the legged locomotion into a single task, the whole-body motion could be planned in a reasonable time. The terrain adaptation strategy is designed to improve the complex terrain passability. Ground reaction forces are then optimised based on single rigid-body dynamics with heuristics. This framework utilised simple but powerful heuristics to approximate complex dynamics and allows for a single set of parameters for all task conditions. Simulation results demonstrate the robustness and adaptability of the proposed framework.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 4","pages":"322-330"},"PeriodicalIF":0.0,"publicationDate":"2022-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12064","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43335590","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yiwei Chong, Jiaming Liang, Tehuan Chen, Chao Xu, Changchun Pan
{"title":"Unsupervised learning on particle image velocimetry with embedded cross-correlation and divergence-free constraint","authors":"Yiwei Chong, Jiaming Liang, Tehuan Chen, Chao Xu, Changchun Pan","doi":"10.1049/csy2.12056","DOIUrl":"10.1049/csy2.12056","url":null,"abstract":"<p>Particle image velocimetry (PIV) is an essential method in experimental fluid dynamics. In recent years, the development of deep learning-based methods has inspired new approaches to tackle the PIV problem, which considerably improves the accuracy of PIV. However, the supervised learning of PIV is driven by large volumes of data with ground truth information. Therefore, the authors consider unsupervised PIV methods. There has been some work on unsupervised PIV, but they are not nearly as effective as supervised learning PIV. The authors try to improve the effectiveness and accuracy of unsupervised PIV by adding classical PIV methods and physical constraints. In this paper, the authors propose an unsupervised PIV method combined with the cross-correlation method and divergence-free constraint, which obtains better performance than other unsupervised PIV methods. The authors compare some classical PIV methods and some deep learning methods, such as LiteFlowNet, LiteFlowNet-en, and UnLiteFlowNet with the authors’ model on the synthetic dataset. Besides, the authors contrast the results of LiteFlowNet, UnLiteFlowNet and the authors’ model on experimental particle images. As a result, the authors’ model shows comparable performance with classical PIV methods as well as supervised PIV methods and outperforms the previous unsupervised PIV method in most flow cases.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 3","pages":"200-211"},"PeriodicalIF":0.0,"publicationDate":"2022-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12056","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44997054","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Distributed non-ideal leader estimation and formation control for multiple non-holonomic mobile robots","authors":"Peifen Lu, Zhigang Ren, Zongze Wu, Zhipeng Li, Shichao Zhou","doi":"10.1049/csy2.12061","DOIUrl":"10.1049/csy2.12061","url":null,"abstract":"<p>This paper studies a distributed formation problem for non-holonomic mobile robots. Consideration of the leader dynamics of the robots as non-ideal, that is, subject to disturbances/unmodelled variables, is the distinguishing feature of this work. The issue is resolved by a distributed combined disturbance-and-leader estimator, allowing for the distributed reconstruction of the leader's signals. The estimator needs to detect the leader's information and disturbance. In order to reject such disturbance and achieve the formation asymptotically, the control law incorporates the smooth estimator's estimate of the leader disturbance. Furthermore, the stability of the total distributed formation control algorithm is also examined using the Lyapunov technique. Finally, to show the viability of the proposed theoretical results, simulations and actual experiments are carried out.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 3","pages":"163-174"},"PeriodicalIF":0.0,"publicationDate":"2022-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12061","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47102191","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Haoxiang Su, Manlu Liu, Hongwei Liu, Jianwen Huo, Songlin Gou, Qing Su
{"title":"Path planning of hyper-redundant manipulators for narrow spaces","authors":"Haoxiang Su, Manlu Liu, Hongwei Liu, Jianwen Huo, Songlin Gou, Qing Su","doi":"10.1049/csy2.12055","DOIUrl":"10.1049/csy2.12055","url":null,"abstract":"<p>Compared with the traditional manipulator, the hyper-redundant manipulator has the advantage of high flexibility, which is particularly suitable for all kinds of complex working environments. However, the complex space environment requires the hyper-redundant manipulator to have stronger obstacle avoidance ability and adaptability. In order to solve the problems of a large amount of calculation and poor obstacle avoidance effects in the path planning of the hyper-redundant manipulator, this paper introduces the ‘backbone curve’ approach, which transforms the problem of solving joint path points into the behaviour of determining the backbone curve. After the backbone curve approach is used to design the curve that meets the requirements of obstacle avoidance and the end pose, the least squares fitting and the improved space joint fitting are used to match the plane curve and the space curve respectively, and the angle value of each joint of the manipulator is limited by the algorithm. Furthermore, a fusion obstacle avoidance algorithm is proposed to obtain the joint path points of the hyper-redundant manipulator. Compared with the classic Jacobian iteration method, this method can avoid obstacles better, has the advantages of simple calculation, high efficiency, and can fully reflect the geometric characteristics of the manipulator. Simulation experiments have proven the feasibility of the algorithm.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 3","pages":"251-263"},"PeriodicalIF":0.0,"publicationDate":"2022-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12055","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47919382","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zhaojun Li, Xinyan Qin, Jin Lei, Jie Zhang, Huidong Li, Bo Li, Yanqi Wang, Dexin Wang
{"title":"Variable universe fuzzy control of walking stability for flying-walking power line inspection robot based on multi-work conditions","authors":"Zhaojun Li, Xinyan Qin, Jin Lei, Jie Zhang, Huidong Li, Bo Li, Yanqi Wang, Dexin Wang","doi":"10.1049/csy2.12058","DOIUrl":"10.1049/csy2.12058","url":null,"abstract":"<p>To address complex work conditions incredibly challenging to the stability of power line inspection robots, we design a walking mechanism and propose a variable universe fuzzy control (VUFC) method based on multi-work conditions for flying-walking power line inspection robots (FPLIRs). The contributions of this paper are as follows: (1) A flexible pressing component is designed to improve the adaptability of the FPLIR to the ground line slope. (2) The influence of multi-work conditions on the FPLIR's walking stability is quantified using three condition parameters (i.e., slope, slipping degree and swing angle), and their measurement methods are proposed. (3) The VUFC method based on the condition parameters is proposed to improve the walking stability of the FPLIR. Finally, the effect of the VUFC method on walking stability of the FPLIR is teste. The experimental results show that the maximum climbing angle of the FPLIR reaches 29.1°. Compared with the constant pressing force of 30 N, the average value of slipping degree is 0.93°, increasing by 35%. The maximum and average values of robot's swing angle are reduced by 46% and 54%, respectively. By comparing with fuzzy control, the VUFC can provide a more reasonable pressing force while maintaining the walking stability of the FPLIR. The proposed walking mechanism and the VUFC method significantly improve the stability of the FPLIR, providing a reference for structural designs and stability controls of inspection robots.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 3","pages":"212-227"},"PeriodicalIF":0.0,"publicationDate":"2022-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12058","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47585860","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A hybrid tracking control strategy for an unmanned underwater vehicle aided with bioinspired neural dynamics","authors":"Zhe Xu, Tao Yan, Simon X. Yang, S. Andrew Gadsden","doi":"10.1049/csy2.12060","DOIUrl":"10.1049/csy2.12060","url":null,"abstract":"<p>Tracking control has been a vital research topic in robotics. This paper presents a novel hybrid control strategy for an unmanned underwater vehicle (UUV) based on a bioinspired neural dynamics model. An enhanced backstepping kinematic control strategy is first developed to avoid sharp velocity jumps and provides smooth velocity commands relative to conventional methods. Then, a novel sliding mode control is proposed, which is capable of providing smooth and continuous torque commands free from chattering. In comparative studies, the proposed combined hybrid control strategy has ensured control signal smoothness, which is critical in real-world applications, especially for a UUV that needs to operate in complex underwater environments.</p>","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"4 3","pages":"153-162"},"PeriodicalIF":0.0,"publicationDate":"2022-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ietresearch.onlinelibrary.wiley.com/doi/epdf/10.1049/csy2.12060","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78821766","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development of a Crawling Robot for Large Steel Structure Welding","authors":"Xiaoteng Wang, Gang Chen","doi":"10.1109/CYBER55403.2022.9907070","DOIUrl":"https://doi.org/10.1109/CYBER55403.2022.9907070","url":null,"abstract":"The welding process of large steel components is mainly manual, with high labour intensity, high risk factor and low operational efficiency, which cannot meet the requirements of modern enterprise manufacturing. This paper proposed a crawling robot, which is combined with a 6-axis robot through a magnetic suction mobile chassis, and uses a laser tracking system to guide the crawling robot to walk, which solves the problem of the restricted working space of the traditional crawling robot. The crawler welding robot has good mobility and high degrees of freedom, and can be adapted to automated welding of large steel components.","PeriodicalId":34110,"journal":{"name":"IET Cybersystems and Robotics","volume":"23 1","pages":"1212-1217"},"PeriodicalIF":0.0,"publicationDate":"2022-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72584928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}