Frontiers in Robotics and AI最新文献

{"title":"EzSkiROS: enhancing robot skill composition with embedded DSL for early error detection.","authors":"Momina Rizwan, Christoph Reichenbach, Ricardo Caldas, Matthias Mayr, Volker Krueger","doi":"10.3389/frobt.2024.1363443","DOIUrl":"https://doi.org/10.3389/frobt.2024.1363443","url":null,"abstract":"<p><p>When developing general-purpose robot software components, we often lack complete knowledge of the specific contexts in which they will be executed. This limits our ability to make predictions, including our ability to detect program bugs statically. Since running a robot is an expensive task, finding errors at runtime can prolong the debugging loop or even cause safety hazards. This paper proposes an approach to help developers catch these errors as soon as we have some context (typically at pre-launch time) with minimal additional efforts. We use embedded domain-specific language (DSL) techniques to enforce early checks. We describe design patterns suitable for robot programming and show how to use these design patterns for DSL embedding in Python, using two case studies on an open-source robot skill platform SkiROS2, designed for the composition of robot skills. These two case studies help us understand how to use DSL embedding on two abstraction levels: the high-level skill description that focuses on what the robot can do and under what circumstances and the lower-level decision-making and execution flow of tasks. Using our DSL EzSkiROS, we show how our design patterns enable robotics software platforms to detect bugs in the high-level contracts between the robot's capabilities and the robot's understanding of the world. We also apply the same techniques to detect bugs in the lower-level implementation code, such as writing behavior trees (BTs), to control the robot's behavior based on its capabilities. We perform consistency checks during the code deployment phase, significantly earlier than the typical runtime checks. This enhances the overall safety by identifying potential issues with the skill execution before they can impact robot behavior. An initial study with SkiROS2 developers shows that our DSL-based approach is useful for finding bugs early and thus improving the maintainability of the code.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1363443"},"PeriodicalIF":2.9,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11738934/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143013928","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Informed circular fields: a global reactive obstacle avoidance framework for robotic manipulators.","authors":"Marvin Becker, Philipp Caspers, Torsten Lilge, Sami Haddadin, Matthias A Müller","doi":"10.3389/frobt.2024.1447351","DOIUrl":"10.3389/frobt.2024.1447351","url":null,"abstract":"<p><p>In this paper, we present a global reactive motion planning framework designed for robotic manipulators navigating in complex dynamic environments. Utilizing local minima-free circular fields, our methodology generates reactive control commands while also leveraging global environmental information from arbitrary configuration space motion planners to identify promising trajectories around obstacles. Furthermore, we extend the virtual agents framework introduced in Becker et al. (2021) to incorporate this global information, simulating multiple robot trajectories with varying parameter sets to enhance avoidance strategies. Consequently, the proposed unified robotic motion planning framework seamlessly combines global trajectory planning with local reactive control and ensures comprehensive obstacle avoidance for the entire body of a robotic manipulator. The efficacy of the proposed approach is demonstrated through rigorous testing in over 4,000 simulation scenarios, where it consistently outperforms existing motion planners. Additionally, we validate our framework's performance in real-world experiments using a collaborative Franka Emika robot with vision feedback. Our experiments illustrate the robot's ability to promptly adapt its motion plan and effectively avoid unpredictable movements by humans within its workspace. Overall, our contributions offer a robust and versatile solution for global reactive motion planning in dynamic environments.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1447351"},"PeriodicalIF":2.9,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11738950/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143013933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Building for speech: designing the next-generation of social robots for audio interaction.","authors":"Angus Addlesee, Ioannis Papaioannou","doi":"10.3389/frobt.2024.1356477","DOIUrl":"10.3389/frobt.2024.1356477","url":null,"abstract":"<p><p>There have been significant advances in robotics, conversational AI, and spoken dialogue systems (SDSs) over the past few years, but we still do not find social robots in public spaces such as train stations, shopping malls, or hospital waiting rooms. In this paper, we argue that early-stage collaboration between robot designers and SDS researchers is crucial for creating social robots that can legitimately be used in real-world environments. We draw from our experiences running experiments with social robots, and the surrounding literature, to highlight recurring issues. Robots need better speakers, a greater number of high-quality microphones, quieter motors, and quieter fans to enable human-robot spoken interaction in the wild. If a robot was designed to meet these requirements, researchers could create SDSs that are more accessible, and able to handle multi-party conversations in populated environments. Robust robot joints are also needed to limit potential harm to older adults and other more vulnerable groups. We suggest practical steps towards future real-world deployments of conversational AI systems for human-robot interaction.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1356477"},"PeriodicalIF":2.9,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11738917/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143013921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Editorial: Creative approaches to appropriation and design: novel robotic systems for heterogeneous contexts.","authors":"Richard Paluch, Felix Carros, Galina Volkova, Mohammad Obaid, Claudia Müller","doi":"10.3389/frobt.2024.1531132","DOIUrl":"https://doi.org/10.3389/frobt.2024.1531132","url":null,"abstract":"","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1531132"},"PeriodicalIF":2.9,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11738912/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143013924","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"From construction machines to remote construction robots: control, interfaces, and usability of the Cranebot.","authors":"Alessandra Duz, Francesca Negrello, Alexandr Rucodainii, Daniel Lanzoni, Mario Corsanici, Angelo Iapichino, Andrea Vitali, Daniele Regazzoni, Valentino Birolini, Roberto Signori, Rossano Ceresoli, Giorgio Grioli, Antonio Bicchi, Manuel G Catalano","doi":"10.3389/frobt.2024.1504317","DOIUrl":"https://doi.org/10.3389/frobt.2024.1504317","url":null,"abstract":"<p><p>Construction machines, for example cranes, excavators, or bulldozers, are widely diffused systems operating outdoors in harsh and dangerous environments, such as building sites, forests, and mines. Typically, construction machines require the on-site presence of highly skilled users to manage the complexity of their control and the high power of hydraulic actuation. Construction machines could benefit from recent developments of robot avatar technology that has demonstrated the viability of remotizing human physical activities, leveraging on intuitive interfaces and controls. Similar approaches could also improve the overall usability of construction machines, making them safer and accessible for untrained users. With this in mind, we developed a novel system for the remote control of cranes through intuitive and immersive interfaces. To validate the solution, we evaluated the experience of approximately 80 untrained users that remotely operated a crane during the 33rd Edition of Bauma, the world's leading fair for construction machines.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1504317"},"PeriodicalIF":2.9,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11738943/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143013931","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"MACRPO: Multi-agent cooperative recurrent policy optimization.","authors":"Eshagh Kargar, Ville Kyrki","doi":"10.3389/frobt.2024.1394209","DOIUrl":"https://doi.org/10.3389/frobt.2024.1394209","url":null,"abstract":"<p><p>This work considers the problem of learning cooperative policies in multi-agent settings with partially observable and non-stationary environments without a communication channel. We focus on improving information sharing between agents and propose a new multi-agent actor-critic method called <i>Multi-Agent Cooperative Recurrent Proximal Policy Optimization</i> (MACRPO). We propose two novel ways of integrating information across agents and time in MACRPO: First, we use a recurrent layer in the critic's network architecture and propose a new framework to use the proposed meta-trajectory to train the recurrent layer. This allows the network to learn the cooperation and dynamics of interactions between agents, and also handle partial observability. Second, we propose a new advantage function that incorporates other agents' rewards and value functions by controlling the level of cooperation between agents using a parameter. The use of this control parameter is suitable for environments in which the agents are unable to fully cooperate with each other. We evaluate our algorithm on three challenging multi-agent environments with continuous and discrete action spaces, Deepdrive-Zero, Multi-Walker, and Particle environment. We compare the results with several ablations and state-of-the-art multi-agent algorithms such as MAGIC, IC3Net, CommNet, GA-Comm, QMIX, MADDPG, and RMAPPO, and also single-agent methods with shared parameters between agents such as IMPALA and APEX. The results show superior performance against other algorithms. The code is available online at https://github.com/kargarisaac/macrpo.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1394209"},"PeriodicalIF":2.9,"publicationDate":"2024-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11695781/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142933100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation.","authors":"Alex van den Berg, Jelle Hofland, Cock J M Heemskerk, David A Abbink, Luka Peternel","doi":"10.3389/frobt.2024.1427095","DOIUrl":"10.3389/frobt.2024.1427095","url":null,"abstract":"<p><p>In recent years, providing additional visual feedback about the interaction forces has been found to offer benefits to haptic-assisted teleoperation. However, there is limited insight into the effects of the design of force feedback-related visual cues and the type of visual display on the performance of teleoperation of robotic arms executing industrial tasks. In this study, we provide new insights into this interaction by extending these findings to the haptic assistance teleoperation of a simulated robotic arm in a virtual environment, in which the haptic assistance is comprised of a set of virtual fixtures. We design a novel method for providing visual cues about the interaction forces to complement the haptic assistance and augment visual feedback in virtual reality with a head-mounted display. We evaluate the visual cues method and head-mounted display method through human factors experiments in a teleoperated dross removal use case. The results show that both methods are beneficial for task performance, each of them having stronger points in different aspects of the operation. The visual cues method was found to significantly improve safety in terms of peak collision force, whereas the head-mounted display additionally improves the performance significantly. Furthermore, positive scores of the subjective analysis indicate an increased user acceptance of both methods. This work provides a new study on the importance of visual feedback related to (interaction) forces and spatial information for haptic assistance and provides two methods to take advantage of its potential benefits in the teleoperation of robotic arms.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1427095"},"PeriodicalIF":2.9,"publicationDate":"2024-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11688239/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142915947","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Launching Stealth AutoGuide^TM robot for stereotactic biopsy procedures in a neurosurgical centre: learning curve and workflow optimization.","authors":"Marcus Barth, Etienne Holl, Fabian Flaschka, Sila Karakaya, Vitus Körbler, Melanie Pichlsberger, Stefan Wolfsberger, Alexander Micko","doi":"10.3389/frobt.2024.1437568","DOIUrl":"10.3389/frobt.2024.1437568","url":null,"abstract":"<p><strong>Background: </strong>Accurate histological analysis is crucial for confirming intracerebral neoplasia due to the diverse array of potential diagnoses presented by imaging. In the realm of biopsy techniques, the use of robot-based systems is on the rise, primarily owing to their heightened targeting accuracy. The objective of this study was to elucidate the practicality, learning curve and workflow associated with robot-guided biopsies upon their introduction to a neurosurgical centre.</p><p><strong>Materials and methods: </strong>In March 2022, the neurosurgical department at our institution adopted the Medtronic Stealth AutoGuide™ cranial robotic guidance platform, a miniaturized robotic guidance device designed for stereotactic procedures. Four experienced neurosurgeons underwent training with the Stealth AutoGuide™ system, after which 51 consecutive biopsies were performed. The evaluation encompassed entry and target accuracy, preoperative setup time, time required for the biopsy procedure, and overall operating time. Statistical analysis was conducted to identify any differences between the initial 26 and subsequent sets of 25 patients, with the aim of identifying changes in workflow.</p><p><strong>Results: </strong>The study included all patients necessitating a diagnostic biopsy for intracerebral tumours, with only one patient excluded due to the inaccessibility of the intended target point caused by tumour calcification. Notably, there were no significant differences between the first 25 and last 26 patients in the median time from incision to the first biopsy (overall: 11.5 min, IQR 9.03-15.0), the procedure time (overall: 30.0 min, IQR 23.5-46.5), median accuracy at entry (overall: 2.05 mm, IQR 0.8-3.8), or target point (overall: 2.2 mm (IQR 1.6-3.7). However, a significant reduction in robot setup time was observed between the two groups, median 2.69 min versus 1.17 min, respectively (p ≤ 0.001).</p><p><strong>Conclusion: </strong>The deployment of the robotic biopsy system, Stealth AutoGuide™, showed high feasibility, steep learning curve due to uncomplicated technical handling using our standardized operative workflow. Therefore, even in prone position a high diagnostic yield was achieved. Overall, the Stealth AutoGuide™ system facilitated biopsies in traditionally challenging regions with concise procedure time and surgeon-independent high accuracy.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1437568"},"PeriodicalIF":2.9,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11685092/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142915949","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"What about spiritual needs? Care robotics and spiritual care.","authors":"Jonas Simmerlein, Max Tretter","doi":"10.3389/frobt.2024.1455133","DOIUrl":"10.3389/frobt.2024.1455133","url":null,"abstract":"<p><p>Health is a multidimensional phenomenon encompassing physical, mental, social, and spiritual aspects. Therefore, it is only logical that good care should be holistic and include all these dimensions. However, when examining the current field of health and care robotics, the spiritual aspect is notably neglected. As a result, current health and care robots cannot provide holistic care. This paper argues that this neglect should be addressed, and, drawing on the emerging field of spiritual robotics, that spiritual aspects should receive greater attention when considering, developing, or deploying health and care robots. We also propose guidelines for equipping health and care robots with the necessary spiritual capabilities.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1455133"},"PeriodicalIF":2.9,"publicationDate":"2024-12-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11685044/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142915951","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Multiuser design of an architecture for social robots in education: teachers, students, and researchers perspectives.","authors":"Daniel C Tozadore, Roseli A F Romero","doi":"10.3389/frobt.2024.1409671","DOIUrl":"10.3389/frobt.2024.1409671","url":null,"abstract":"<p><p>Research on social assistive robots in education faces many challenges that extend beyond technical issues. On one hand, hardware and software limitations, such as algorithm accuracy in real-world applications, render this approach difficult for daily use. On the other hand, there are human factors that need addressing as well, such as student motivations and expectations toward the robot, teachers' time management and lack of knowledge to deal with such technologies, and effective communication between experimenters and stakeholders. In this paper, we present a complete evaluation of the design process for a robotic architecture targeting teachers, students, and researchers. The contribution of this work is three-fold: (i) we first present a high-level assessment of the studies conducted with students and teachers that allowed us to build the final version of the architecture's module and its graphical interface; (ii) we present the R-CASTLE architecture from a technical perspective and its implications for developers and researchers; and, finally, (iii) we validated the R-CASTLE architecture with an in-depth qualitative analysis with five new teachers. Findings suggest that teachers can intuitively import their daily activities into our architecture at first glance, even without prior contact with any social robot.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"11 ","pages":"1409671"},"PeriodicalIF":2.9,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11683562/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142907783","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}