Muhammad Shaheer;Jose Andres Millan-Romera;Hriday Bavle;Marco Giberna;Jose Luis Sanchez-Lopez;Javier Civera;Holger Voos
{"title":"Tightly Coupled SLAM With Imprecise Architectural Plans","authors":"Muhammad Shaheer;Jose Andres Millan-Romera;Hriday Bavle;Marco Giberna;Jose Luis Sanchez-Lopez;Javier Civera;Holger Voos","doi":"10.1109/LRA.2025.3582108","DOIUrl":"https://doi.org/10.1109/LRA.2025.3582108","url":null,"abstract":"Robots navigating indoor environments often have access to architectural plans, which can serve as prior knowledge to enhance their localization and mapping capabilities. While some SLAM algorithms leverage these plans for global localization in real-world environments, they typically overlook a critical challenge: the “as-planned” architectural designs frequently deviate from the “as-built” real-world environments. To address this gap, we present a novel algorithm that tightly couples LIDAR-based simultaneous localization and mapping with architectural plans in the presence of deviations. Our method utilizes a multi-layered semantic representation to not only localize the robot, but also to estimate global alignment and structural deviations between “as-planned” and “as-built” environments in real-time. To validate our approach, we performed experiments in simulated and real datasets demonstrating robustness to structural deviations up to 35 cm and <inline-formula><tex-math>$15^circ$</tex-math></inline-formula>. On average, our method achieves 43% less localization error than baselines in simulated environments, while in real environments, the “as-built” 3D maps show 7% lower average alignment error.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8019-8026"},"PeriodicalIF":4.6,"publicationDate":"2025-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11045969","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144519468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Paolo Susini;Giulia Pagnanelli;Saekwang Nam;Nathan F. Lepora;Matteo Bianchi
{"title":"Data-Driven Compliance Discrimination via Biomimetic Soft Optical Tactile Sensors: Implementation and Benchmarking With a Model-Based Approach","authors":"Paolo Susini;Giulia Pagnanelli;Saekwang Nam;Nathan F. Lepora;Matteo Bianchi","doi":"10.1109/LRA.2025.3582538","DOIUrl":"https://doi.org/10.1109/LRA.2025.3582538","url":null,"abstract":"Humans can easily manipulate soft, deformable objects, relying on the intrinsic deformability of theirfingerpads and their capabilities to infer item compliance. Transferring these skills into robotic systems is still an open challenging task. Recently, the introduction of soft biomimetic tactile sensors such as the TacTip, which aims at mimicking the structure of human skin layers, has represented an attempt to bridge this gap. However, while the advancement in endowing artificial systems with bio-aware embodied intelligence, the computational aspects of compliance estimation are still largely unexplored, mostly relying on Data-Driven (DD) methods. In a previous work [Pagnanelli, et al. (2023)], a model-based approach to compliance estimation by combining TacTip with a computational model of human tactile perception has been proposed. However, both these categories of techniques suffer from limitations (generalizability issues for the model-inspired; the curse of data for DD), suggesting that a hybrid approach could represent a more suitable solution. The first step in exploring the feasibility of a hybrid framework is to develop robust neural network architectures and then benchmark them against the results achieved through the analytical method. In this manner, we can assess their complementary strengths and potential integration. This work specifically addresses this step by proposing a novel approach for compliance estimation via TacTip using deep learning techniques. The neural network architecture was validated, and a comparative analysis of its performance against our previously developed model-based approach was performed.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8083-8090"},"PeriodicalIF":4.6,"publicationDate":"2025-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144536385","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Distributional Treatment of Real2Sim2Real for Object-Centric Agent Adaptation in Vision-Driven DLO Manipulation","authors":"Georgios Kamaras;Subramanian Ramamoorthy","doi":"10.1109/LRA.2025.3581744","DOIUrl":"https://doi.org/10.1109/LRA.2025.3581744","url":null,"abstract":"We present an integrated (or end-to-end) framework for the Real2Sim2Real problem of manipulating deformable linear objects (DLOs) based on visual perception. Working with a parameterised set of DLOs, we use likelihood-free inference (LFI) to compute the posterior distributions for the physical parameters using which we can approximately simulate the behaviour of each specific DLO. We use these posteriors for domain randomisation while training, in simulation, object-specific visuomotor policies (i.e. assuming only visual and proprioceptive sensory) for a DLO reaching task, using model-free reinforcement learning. We demonstrate the utility of this approach by deploying sim-trained DLO manipulation policies in the real world in a zero-shot manner, i.e. without any further fine-tuning. In this context, we evaluate the capacity of a prominent LFI method to perform fine classification over the parametric set of DLOs, using only visual and proprioceptive data obtained in a dynamic manipulation trajectory. We then study the implications of the resulting domain distributions in sim-based policy learning and real-world performance.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8075-8082"},"PeriodicalIF":4.6,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144536534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"OverlapMamba: A Shift State Space Model for LiDAR-Based Place Recognition","authors":"Jiehao Luo;Jintao Cheng;Qiuchi Xiang;Jin Wu;Rui Fan;Xieyuanli Chen;Xiaoyu Tang","doi":"10.1109/LRA.2025.3582109","DOIUrl":"https://doi.org/10.1109/LRA.2025.3582109","url":null,"abstract":"Place recognition is the foundation for autonomous systems to achieve independent decision-making and secure operation. It is also crucial in tasks such as loop closure detection and global localization in Simultaneous Localization and Mapping (SLAM) technology. Existing LiDAR-based place recognition (LPR) methods use raw point cloud representations or multifarious point cloud representations as inputs, as well as employ convolutional neural networks or transformer architectures. However, the recently proposed Mamba deep learning model combined with State Space Models (SSMs) has enormous potential in long sequence modeling. Therefore, we have developed a novel place recognition network OverlapMamba, which represents input range images as sequences. In a novel way, we use a stochastic reconstruction method to establish shifted state space models to compress the visual representation. Extensive experiments on three public datasets demonstrate that OverlapMamba achieves competitive performance with real-time inference speed, which effectively detects loop closure even when traversing previously visited locations from different directions, indicating its strong place recognition ability and real-time efficiency.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8380-8387"},"PeriodicalIF":4.6,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144597759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Optimization of Preemptive Impact Mitigation Without Prior Collision Testing","authors":"Hayato Nakamura;Hikaru Arita;Shunsuke Tokiwa;Kenji Tahara","doi":"10.1109/LRA.2025.3582137","DOIUrl":"https://doi.org/10.1109/LRA.2025.3582137","url":null,"abstract":"Effective impact mitigation strategies are crucial for preventing potential damage to both robotic systems and their operational environments during high-velocity and dynamic maneuvers, as well as during the execution of high-precision tasks. The successful implementation of impact mitigation strategies in real-world applications fundamentally requires appropriate parameter tuning. However, owing to the destructive nature of collisions, heuristic parameter tuning is impractical, as it risks damage to both the robotic system and its operational environment during experimental trials. This study eliminates the need for preliminary collision experiments in parameter optimization by introducing a novel methodology that leverages recent proximity sensor-based preemptive impact mitigation strategies that reframe impact mitigation as a geometric rather than physical problem. The key innovation of this work lies in the reformulation of the proximity sensor output to enable both the analytical derivation of preemptive motion trajectories and the direct application of standard optimization solvers. The effectiveness of the proposed methodology is validated through numerical simulations and two different experimental configurations. By eliminating the need for collision trials, robotic systems can safely execute potentially destructive tasks that would otherwise result in system damage without proper impact mitigation.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8059-8066"},"PeriodicalIF":4.6,"publicationDate":"2025-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11045938","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144519465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Md Mostafizur Rahman Komol;Brendan Tidd;Will Browne;Frederic Maire;Jason Williams;David Howard
{"title":"Learning Behaviours for Decentralised Multi-Robot Collision Avoidance in Constrained Pathways Using Curriculum Reinforcement Learning","authors":"Md Mostafizur Rahman Komol;Brendan Tidd;Will Browne;Frederic Maire;Jason Williams;David Howard","doi":"10.1109/LRA.2025.3581430","DOIUrl":"https://doi.org/10.1109/LRA.2025.3581430","url":null,"abstract":"Mobile robot teams often require decentralised autonomous navigation through narrow gaps in limited communication environments (e.g., underground search-and-rescue operations). Existing navigation approaches exhibit suboptimal performance for avoiding multi-robot collisions in such bottlenecks due to an inability to address the dynamic nature of the robots. Initial work utilising reinforcement learning has demonstrated success in navigating a single robot through narrow gaps. However, when training agents to produce give-way behaviour for navigating through constrained gaps, end-to-end reinforcement learning using simple rewards suffers from slow convergence due to the increased search space of viable policies. This paper introduces a novel curriculum reinforcement learning framework, incorporating a <italic>multi-robot bootstrap curriculum</i> with preprogrammed behaviour to guide initial policy formation, subsequently refined by a <italic>gap curriculum</i> that progressively reduces training complexity towards an optimal policy. This framework learns multi-robot interaction behaviours, which are impractical to program manually. Our model achieves a 99% success-rate in give-way behaviour generation without inter-agent communications in high-fidelity simulations. The success-rate reduced to 73% in simulations incorporating noisy sensors, and 60% in field-robot tests, substantiating our model's practical viability despite sensor noise and real-world uncertainties. The simple benchmark methods lack efficiency in basic interaction behaviours.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8538-8545"},"PeriodicalIF":4.6,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144634880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Antonio Marino;Esteban Restrepo;Claudio Pacchierotti;Paolo Robuffo Giordano
{"title":"Decentralized Reinforcement Learning for Multi-Agent Multi-Resource Allocation via Dynamic Cluster Agreements","authors":"Antonio Marino;Esteban Restrepo;Claudio Pacchierotti;Paolo Robuffo Giordano","doi":"10.1109/LRA.2025.3581126","DOIUrl":"https://doi.org/10.1109/LRA.2025.3581126","url":null,"abstract":"This letter addresses the challenge of allocating heterogeneous resources among multiple agents in a decentralized manner. Our proposed method, Liquid-Graph-Time Clustering-IPPO, builds upon Independent Proximal Policy Optimization (IPPO) by integrating dynamic cluster consensus, a mechanism that allows agents to form and adapt local sub-teams based on resource demands. This decentralized coordination strategy reduces reliance on global information and enhances scalability. We evaluate LGTC-IPPO against standard multi-agent reinforcement learning baselines and a centralized expert solution across a range of team sizes and resource distributions. Experimental results demonstrate that LGTC-IPPO achieves more stable rewards, better coordination, and robust performance even as the number of agents or resource types increases. Additionally, we illustrate how dynamic clustering enables agents to reallocate resources efficiently also for scenarios with discharging resources.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8123-8130"},"PeriodicalIF":4.6,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144550398","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Bioinspired Microrobot Climbing on Fabrics Using a Single Actuator","authors":"Jiliang Ma;Jun Peng;Yusen Ma;Kanglong Yuan;Ao Qin;Wenwu Zhu;Xuefeng Chen","doi":"10.1109/LRA.2025.3581124","DOIUrl":"https://doi.org/10.1109/LRA.2025.3581124","url":null,"abstract":"Microrobots climbing on fabrics are well-suited for reconnaissance and rescue tasks in indoor environments. However, achieving stable adhesion while maintaining a simplified locomotion mechanism remains a formidable challenge. This study presents a 4 cm, 18.2 g climbing robot designed with a single-actuator, enabling dual-degree-of-freedom motion on fabric surfaces through the synergistic integration of anisotropic microstructures. The robot's compact form achieves complex functionalities, incorporating locomotion, imaging, illumination, and real-time video transmission capabilities. Innovative hook-shaped microstructures overcome challenges in gripping rough and fibrous surfaces (wood, burlap, mesh, etc.), allowing robots to climb on slopes up to 55° and maintain stillness on inverted surfaces. This work demonstrates the robot's feasibility and efficiency for reconnaissance applications on varied indoor surfaces through structural design optimization and performance testing in simulated real-world environments.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"8011-8018"},"PeriodicalIF":4.6,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144519326","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"I2D-LocX: An Efficient, Precise and Robust Method for Camera Localization in LiDAR Maps","authors":"Huai Yu;Xubo Zhu;Shu Han;Wen Yang;Gui-Song Xia","doi":"10.1109/LRA.2025.3581122","DOIUrl":"https://doi.org/10.1109/LRA.2025.3581122","url":null,"abstract":"Camera localization within LiDAR maps has gained significant attention due to its potential for accurate positioning with low-cost and lightweight sensors compared to LiDAR-based systems. However, existing methods often prioritize localization accuracy, sometimes compromising efficiency, which can limit their suitability for real-time applications. To address these issues, we propose I2D-LocX, a lightweight monocular camera localization framework with three branches, establishing pixel-level and feature-level constraints to enhance localization performance without increasing model complexity. Specifically, the main branch generates a flow map to represent pixel-point displacements. One auxiliary branch shares the same input as the main branch and employs an additional decoder to evaluate the confidence of the flow map. The other auxiliary branch leverages a zero-flow generated from the displacement-free input to guide feature matching, thereby enhancing localization robustness. Notably, both auxiliary branches share parameters with the main branch and are omitted during inference, ensuring computational efficiency. Extensive experiments on benchmark datasets, including KITTI-Odometry, Argoverse, Waymo, and nuScenes, show that I2D-LocX can achieve centimeter-level localization accuracy with about 37 ms inference time, greatly improving the localization performance for real-world applications.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"7899-7906"},"PeriodicalIF":4.6,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144481900","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yimin Han;Jiahui Zhang;Zeren Luo;Yingzhao Dong;Jinghan Lin;Liu Zhao;Shihao Dong;Peng Lu
{"title":"OmniNet: Omnidirectional Jumping Neural Network With Height-Awareness for Quadrupedal Robots","authors":"Yimin Han;Jiahui Zhang;Zeren Luo;Yingzhao Dong;Jinghan Lin;Liu Zhao;Shihao Dong;Peng Lu","doi":"10.1109/LRA.2025.3580993","DOIUrl":"https://doi.org/10.1109/LRA.2025.3580993","url":null,"abstract":"In the robotics community, it has been a longstanding challenge for quadrupeds to achieve highly explosive movements similar to their biological counterparts. In this work, we introduce a novel training framework that achieves height-aware and omnidirectional jumping for quadrupedal robots. To facilitate the precise tracking of the user-specified jumping height, our pipeline concurrently trains an estimator that infers the robot and its end-effector states in an online fashion. Besides, a novel reward is involved by solving the analytical inverse kinematics with pre-defined end-effector positions. Guided by this term, the robot is empowered to regulate its gestures during the aerial phase. In the comparative studies, we verify that this controller can not only achieve the longest relative forward jump distance, but also exhibit the most comprehensive jumping capabilities among all the existing jumping controllers. A video summarizing the methodology and the validation in both simulation and real hardware is submitted along with this paper.","PeriodicalId":13241,"journal":{"name":"IEEE Robotics and Automation Letters","volume":"10 8","pages":"7915-7922"},"PeriodicalIF":4.6,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144481938","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}