Hongyu Zhang , Guoliang Li , Dapeng Wan , Ziyue Wang , Jinshun Dong , Shoujun Lin , Lixia Deng , Haiying Liu
{"title":"DS-YOLO: A dense small object detection algorithm based on inverted bottleneck and multi-scale fusion network","authors":"Hongyu Zhang , Guoliang Li , Dapeng Wan , Ziyue Wang , Jinshun Dong , Shoujun Lin , Lixia Deng , Haiying Liu","doi":"10.1016/j.birob.2024.100190","DOIUrl":"10.1016/j.birob.2024.100190","url":null,"abstract":"<div><div>In the field of security, intelligent surveillance tasks often involve a large number of dense and small objects, with severe occlusion between them, making detection particularly challenging. To address this significant challenge, Dense and Small YOLO (DS-YOLO), a dense small object detection algorithm based on YOLOv8s, is proposed in this paper. Firstly, to enhance the dense small objects’ feature extraction capability of backbone network, the paper proposes a lightweight backbone. The improved C2fUIB is employed to create a lightweight model and expand the receptive field, enabling the capture of richer contextual information and reducing the impact of occlusion on detection accuracy. Secondly, to enhance the feature fusion capability of model, a multi-scale feature fusion network, Light-weight Full Scale PAFPN (LFS-PAFPN), combined with the DO-C2f module, is introduced. The new module successfully reduces the miss rate of dense small objects while ensuring the accuracy of detecting large objects. Finally, to minimize feature loss of dense objects during network transmission, a dynamic upsampling module, DySample, is implemented. DS-YOLO was trained and tested on the CrowdHuman and VisDrone2019 datasets, which contain a large number of densely populated pedestrians, vehicles and other objects. Experimental evaluations demonstrated that DS-YOLO has advantages in dense small object detection tasks. Compared with YOLOv8s, the Recall and [email protected] are increased by 4.9% and 4.2% on CrowdHuman dataset, 4.6% and 5% on VisDrone2019, respectively. Simultaneously, DS-YOLO does not introduce a substantial amount of computing overhead, maintaining low hardware requirements.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100190"},"PeriodicalIF":0.0,"publicationDate":"2024-10-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552404","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Timothy Sellers , Tingjun Lei , Chaomin Luo , Zhuming Bi , Gene Eu Jan
{"title":"Human autonomy teaming-based safety-aware navigation through bio-inspired and graph-based algorithms","authors":"Timothy Sellers , Tingjun Lei , Chaomin Luo , Zhuming Bi , Gene Eu Jan","doi":"10.1016/j.birob.2024.100189","DOIUrl":"10.1016/j.birob.2024.100189","url":null,"abstract":"<div><div>In the field of autonomous robots, achieving complete precision is challenging, underscoring the need for human intervention, particularly in ensuring safety. Human Autonomy Teaming (HAT) is crucial for promoting safe and efficient human–robot collaboration in dynamic indoor environments. This paper introduces a framework designed to address these precision gaps, enhancing safety and robotic interactions within such settings. Central to our approach is a hybrid graph system that integrates the Generalized Voronoi Diagram (GVD) with spatio-temporal graphs, effectively combining human feedback, environmental factors, and key waypoints. An integral component of this system is the improved Node Selection Algorithm (iNSA), which utilizes the revised Grey Wolf Optimization (rGWO) for better adaptability and performance. Furthermore, an obstacle tracking model is employed to provide predictive data, enhancing the efficiency of the system. Human insights play a critical role, from supplying initial environmental data and determining key waypoints to intervening during unexpected challenges or dynamic environmental changes. Extensive simulation and comparison tests confirm the reliability and effectiveness of our proposed model, highlighting its unique advantages in the domain of HAT. This comprehensive approach ensures that the system remains robust and responsive to the complexities of real-world applications.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100189"},"PeriodicalIF":0.0,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142702506","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Design of FDM-printable tendon-driven continuum robots using a serial S-shaped backbone structure","authors":"Kaidi Zhu, Tim C. Lueth, Yilun Sun","doi":"10.1016/j.birob.2024.100188","DOIUrl":"10.1016/j.birob.2024.100188","url":null,"abstract":"<div><div>Tendon-driven continuum robots (TDCR) are widely used in various engineering disciplines due to their exceptional flexibility and dexterity. However, their complex structure often leads to significant manufacturing costs and lengthy prototyping cycles. To cope with this problem, we propose a fused-deposition-modeling-printable (FDM-printable) TDCR structure design using a serial S-shaped backbone, which enables planar bending motion with minimized plastic deformation. A kinematic model for the proposed TDCR structure based on the pseudo-rigid-body model (PRBM) approach is developed. Experimental results have revealed that the proposed kinematic model can effectively predict the bending motion under certain tendon forces. In addition, analyses of mechanical hysteresis and factors influencing bending stiffness are conducted. Finally, A three-finger gripper is fabricated to demonstrate a possible application of the proposed TDCR structure.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"5 1","pages":"Article 100188"},"PeriodicalIF":0.0,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143151588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Editorial for the special issue on bio-inspired robotic dexterity intelligence","authors":"Qiang Li, Shuo Wang, Cong Wang, Jihong Zhu","doi":"10.1016/j.birob.2024.100186","DOIUrl":"10.1016/j.birob.2024.100186","url":null,"abstract":"","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100186"},"PeriodicalIF":0.0,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shilong Sun , Chiyao Li , Zida Zhao , Haodong Huang , Wenfu Xu
{"title":"Leveraging large language models for comprehensive locomotion control in humanoid robots design","authors":"Shilong Sun , Chiyao Li , Zida Zhao , Haodong Huang , Wenfu Xu","doi":"10.1016/j.birob.2024.100187","DOIUrl":"10.1016/j.birob.2024.100187","url":null,"abstract":"<div><div>This paper investigates the utilization of large language models (LLMs) for the comprehensive control of humanoid robot locomotion. Traditional reinforcement learning (RL) approaches for robot locomotion are resource-intensive and rely heavily on manually designed reward functions. To address these challenges, we propose a method that employs LLMs as the primary designer to handle key aspects of locomotion control, such as trajectory planning, inverse kinematics solving, and reward function design. By using user-provided prompts, LLMs generate and optimize code, reducing the need for manual intervention. Our approach was validated through simulations in Unity, demonstrating that LLMs can achieve human-level performance in humanoid robot control. The results indicate that LLMs can simplify and enhance the development of advanced locomotion control systems for humanoid robots.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100187"},"PeriodicalIF":0.0,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142552406","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zefan Su , Hanchen Yao , Jianwei Peng , Zhelin Liao , Zengwei Wang , Hui Yu , Houde Dai , Tim C. Lueth
{"title":"LQR-based control strategy for improving human–robot companionship and natural obstacle avoidance","authors":"Zefan Su , Hanchen Yao , Jianwei Peng , Zhelin Liao , Zengwei Wang , Hui Yu , Houde Dai , Tim C. Lueth","doi":"10.1016/j.birob.2024.100185","DOIUrl":"10.1016/j.birob.2024.100185","url":null,"abstract":"<div><div>In the dynamic and unstructured environment of human–robot symbiosis, companion robots require natural human–robot interaction and autonomous intelligence through multimodal information fusion to achieve effective collaboration. Nevertheless, the control precision and coordination of the accompanying actions are not satisfactory in practical applications. This is primarily attributed to the difficulties in the motion coordination between the accompanying target and the mobile robot. This paper proposes a companion control strategy based on the Linear Quadratic Regulator (LQR) to enhance the coordination and precision of robot companion tasks. This method enables the robot to adapt to sudden changes in the companion target’s motion. Besides, the robot could smoothly avoid obstacles during the companion process. Firstly, a human–robot companion interaction model based on nonholonomic constraints is developed to determine the relative position and orientation between the robot and the companion target. Then, an LQR-based companion controller incorporating behavioral dynamics is introduced to simultaneously avoid obstacles and track the companion target’s direction and velocity. Finally, various simulations and real-world human–robot companion experiments are conducted to regulate the relative position, orientation, and velocity between the target object and the robot platform. Experimental results demonstrate the superiority of this approach over conventional control algorithms in terms of control distance and directional errors throughout system operation. The proposed LQR-based control strategy ensures coordinated and consistent motion with target persons in social companion scenarios.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100185"},"PeriodicalIF":0.0,"publicationDate":"2024-10-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142572802","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yanhong Peng , Yuxin Wang , Fangchao Hu , Miao He , Zebing Mao , Xia Huang , Jun Ding
{"title":"Predictive modeling of flexible EHD pumps using Kolmogorov–Arnold Networks","authors":"Yanhong Peng , Yuxin Wang , Fangchao Hu , Miao He , Zebing Mao , Xia Huang , Jun Ding","doi":"10.1016/j.birob.2024.100184","DOIUrl":"10.1016/j.birob.2024.100184","url":null,"abstract":"<div><div>We present a novel approach to predicting the pressure and flow rate of flexible electrohydrodynamic pumps using the Kolmogorov–Arnold Network. Inspired by the Kolmogorov–Arnold representation theorem, KAN replaces fixed activation functions with learnable spline-based activation functions, enabling it to approximate complex nonlinear functions more effectively than traditional models like Multi-Layer Perceptron and Random Forest. We evaluated KAN on a dataset of flexible EHD pump parameters and compared its performance against RF, and MLP models. KAN achieved superior predictive accuracy, with Mean Squared Errors of 12.186 and 0.012 for pressure and flow rate predictions, respectively. The symbolic formulas extracted from KAN provided insights into the nonlinear relationships between input parameters and pump performance. These findings demonstrate that KAN offers exceptional accuracy and interpretability, making it a promising alternative for predictive modeling in electrohydrodynamic pumping.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100184"},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Human–robot collaborative handling of curtain walls using dynamic motion primitives and real-time human intention recognition","authors":"Fengming Li , Huayan Sun , Enguang Liu , Fuxin Du","doi":"10.1016/j.birob.2024.100183","DOIUrl":"10.1016/j.birob.2024.100183","url":null,"abstract":"<div><div>Human–robot collaboration fully leverages the strengths of both humans and robots, which is crucial for handling large, heavy objects at construction sites. To address the challenges of human–machine cooperation in handling large-scale, heavy objects — specifically building curtain walls — a human–robot collaboration system was designed based on the concept of “human–centered with machine support”. This system allows the handling of curtain walls according to different human intentions. First, a robot trajectory learning and generalization model based on dynamic motion primitives was developed. The operator’s motion intent was then characterized by their speed, force, and torque, with the force impulse introduced to define the operator’s intentions for acceleration and deceleration. Finally, a collaborative experiment was conducted on an experimental platform to validate the robot’s understanding of human handling intentions and to verify its ability to handle curtain wall. Collaboration between humans and robots ensured a smooth and labor-saving handling process.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100183"},"PeriodicalIF":0.0,"publicationDate":"2024-09-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142433593","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yilin Wang, Felix Pancheri, Tim C. Lueth, Yilun Sun
{"title":"Design of a spider-inspired wheeled compliant leg for search mobile robots","authors":"Yilin Wang, Felix Pancheri, Tim C. Lueth, Yilun Sun","doi":"10.1016/j.birob.2024.100182","DOIUrl":"10.1016/j.birob.2024.100182","url":null,"abstract":"<div><div>Earthquake and other disasters nowadays still threat people’s lives and property due to their destructiveness and unpredictability. The past decades have seen the booming development of search and rescue robots due to their potential for increasing rescue capacity as well as reducing personnel safety risk at disaster sites. In this work, we propose a spider-inspired wheeled compliant leg to further improve the environmental adaptability of search mobile robots. Different from the traditional fully-actuated method with independent motor joint control, this leg employs an under-actuated compliant mechanism design with overall semi-tendon-driven control, which enables the passive and active terrain adaptation, system simplification and lightweight of the realized search robot. We have generalized the theoretical model and design methodology for this type of compliant leg, and implement it in a parametric program to improve the design efficiency. In addition, preliminary load capacity and leg-lifting experiments are carried out on a one-leg prototype to evaluate its mechanical performance. A four-legged robot platform is also fabricated for the locomotion tests. The preliminary experimental results have verified the feasibility of the proposed design methodology, and also show possibilities for improvements. In future work, structural optimization and stronger actuation elements should be introduced to further improve the mechanical performance of the fabricated wheeled leg mechanism and robot platform.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100182"},"PeriodicalIF":0.0,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667379724000408/pdfft?md5=bf6e8614b8d99680ff314cdf06a261ce&pid=1-s2.0-S2667379724000408-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142311513","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Delei Fang, Fangyuan Ren, Jianwei Wang, Pan Li, Lin Cao, Junxia Zhang
{"title":"A bionic robotic ankle driven by the multiple pneumatic muscle actuators","authors":"Delei Fang, Fangyuan Ren, Jianwei Wang, Pan Li, Lin Cao, Junxia Zhang","doi":"10.1016/j.birob.2024.100176","DOIUrl":"10.1016/j.birob.2024.100176","url":null,"abstract":"<div><div>The traditional pneumatic muscle robot joint has weak load capacity and low control precision. This paper proposes a bionic robotic ankle driven by multiple pneumatic muscle actuators. The structural design of the bionic robotic ankle and the drive mechanism that imitates human muscle recruitment are introduced. A dynamic model of the ankle and a static model of the pneumatic muscle actuator are established to analyze the driving characteristics. The multi-muscle recruiting strategy and load matching control method are optimized, and the output characteristics are simulated, including the robotic ankle driven by a single pneumatic muscle actuator, the robotic ankle driven by dual pneumatic muscle actuators, and the bionic ankle driven by multiple pneumatic muscle actuators. A prototype and testing platform are developed, and experimental research is carried out to validate the theoretical analysis and simulation. The results show that the bionic robotic ankle driven by multiple pneumatic muscle actuators can match varied loads, effectively reducing angle error and increasing output force.</div></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"4 4","pages":"Article 100176"},"PeriodicalIF":0.0,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142318752","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}