{"title":"BOBCAT: Behaviors, Objectives and Binary states for Coordinated Autonomous Tasks","authors":"Danny G. Riley, E. Frew","doi":"10.1109/IROS47612.2022.9981135","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9981135","url":null,"abstract":"We present our framework Behaviors, Objectives and Binary states for Coordinated Autonomous Tasks (BOBCAT), a multi-agent decision making and task management system for autonomous robots. BOBCAT builds on behavior-based systems and the Belief-Desire-Intention model for decision-making, by using mission objectives as the basis for selecting tasks, or behaviors. We describe how BOBCAT is formulated and present the results of a real-world implementation in the context of exploring austere underground environments in the DARPA Subterranean Challenge.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132528867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Use of Action Label in Deep Predictive Learning for Robot Manipulation","authors":"Kei Kase, Chikara Utsumi, Y. Domae, T. Ogata","doi":"10.1109/IROS47612.2022.9982091","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9982091","url":null,"abstract":"Various forms of human knowledge can be explicitly used to enhance deep robot learning from demonstrations. Annotation of subtasks from task segmentation is one type of human symbolism and knowledge. Annotated subtasks can be referred to as action labels, which are more primitive symbols that can be building blocks for more complex human reasoning, like language instructions. However, action labels are not widely used to boost learning processes because of problems that include (1) real-time annotation for online manipulation, (2) temporal inconsistency by annotators, (3) difference in data characteristics of motor commands and action labels, and (4) annotation cost. To address these problems, we propose the Gated Action Motor Predictive Learning (GAMPL) framework to leverage action labels for improved performance. GAMPL has two modules to obtain soft action labels compatible with motor commands and to generate motion. In this study, GAMPL is evaluated for towel-folding manipulation tasks in a real environment with a six degrees-of-freedom (6 DoF) robot and shows improved generalizability with action labels.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"16 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134151357","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Marten Franke, Ch.Buchi Reddy, Danijela Ristić-Durrant, Jehan Jayawardana, K. Michels, Milan Banić, M. Simonović
{"title":"Towards holistic autonomous obstacle detection in railways by complementing of on-board vision with UAV-based object localization","authors":"Marten Franke, Ch.Buchi Reddy, Danijela Ristić-Durrant, Jehan Jayawardana, K. Michels, Milan Banić, M. Simonović","doi":"10.1109/IROS47612.2022.9981156","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9981156","url":null,"abstract":"This paper presents the two sub-systems of the first holistic system for autonomous obstacle detection (OD) in railways, the on-board vision system and unmanned aerial vehicle (UAV) vision system for object localization (OL) on and near the rail tracks. The main goal of such a holistic system is to enable long-range detection of obstacles on the rail tracks ahead of the train where the UAV-based OL system complements the on-board system in detecting obstacles in the areas that are not visible by the on-board system such as curves. The deep learning (DL)-based object detection and distance estimation in thermal camera unit of the on-board system is presented, as well as the OL based on UAV camera image. The experimental results achieved in a real-world railway experimental scenario that includes obstacles visible only by the on-board thermal camera, only by UAV camera as well as obstacles in the Field of View (FoV) of both systems are presented. These preliminary results show the high potential of developing holistic system where the final decision on OD would be autonomously made and consequently possible actions for the train control would be suggested based on the OD outputs of individual systems having different rail tracks sections in their FoV.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134335638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kübra Karacan, Hamid Sadeghian, R. J. Kirschner, S. Haddadin
{"title":"Passivity-Based Skill Motion Learning in Stiffness-Adaptive Unified Force-Impedance Control","authors":"Kübra Karacan, Hamid Sadeghian, R. J. Kirschner, S. Haddadin","doi":"10.1109/IROS47612.2022.9981728","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9981728","url":null,"abstract":"Tactile robots shall be deployed for dynamic task execution in production lines with small batch sizes. Therefore, these robots should have the ability to respond to changing conditions and be easy to (re-)program. Operating under uncertain environments requires unifying subsystems such as robot motion and force policy into one framework, referred to as tactile skills. In this paper, we propose the enhancement of these skills for passivity-based skill motion learning in stiffness-adaptive unified force-impedance control. To achieve the increased level of adaptability, we represent all tactile skills by three basic primitives: contact initiation, manipulation, and contact termination. To ensure passivity and stability, we develop an energy-based approach for unified force-impedance control that allows humans to teach the robot motion through physical interaction during the execution of a tactile task. We incorporate our proposed framework into a tactile robot to experimentally validate the motion adaptation by interaction performance and stability of the control. While the polishing task is presented as our use case through the paper, the experiments can also be carried out with various tactile skills. Finally, the results show the novel controller's stability and passivity to contact-loss and stiffness adaptation, leading to successful programming by interaction.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"160 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131677731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yu Cao, Jian Huang, Xiaolong Li, Mengshi Zhang, Caihua Xiong, S. Mohammed, Yaonan Zhu, Y. Hasegawa
{"title":"Metabolic Efficiency Improvement of Human Walking by Shoulder Stress Reduction through Load Transfer Backpack","authors":"Yu Cao, Jian Huang, Xiaolong Li, Mengshi Zhang, Caihua Xiong, S. Mohammed, Yaonan Zhu, Y. Hasegawa","doi":"10.1109/IROS47612.2022.9981129","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9981129","url":null,"abstract":"The dynamic load attached to the load gravity imposes an excessive burden to human shoulders during load carriage, resulting in possible muscle injuries and additional physical exertion. This paper proposes an active suspension backpack, capable of transferring partial load from human shoulders to pelvis and alleviating the dynamic load through separated panels and motor actuation, to reduce pressure on human shoulders and improve walking metabolic efficiency. Based on the human body motion in the vertical direction, the dynamical model of the human-backpack system with shoulder interaction force measured by a soft ballonet with an embedded air pressure sensor is introduced, and an impedance controller has been implemented to maintain a relatively small and constant pressure on the shoulder. In an experimental case study, we presents preliminary results of three healthy subjects performing a treadmill walking with a 20kg load in ACTIVE configuration where the shoulder pressure shows a decrease by 30% along with a reduction of the metabolic energy consumption by 16.4%, compared with the load LOCKED case.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"82 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132970880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Easton R. Potokar, Kalliyan Lay, Kalin Norman, Derek Benham, T. Neilsen, M. Kaess, Joshua G. Mangelson
{"title":"HoloOcean: Realistic Sonar Simulation","authors":"Easton R. Potokar, Kalliyan Lay, Kalin Norman, Derek Benham, T. Neilsen, M. Kaess, Joshua G. Mangelson","doi":"10.1109/IROS47612.2022.9981119","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9981119","url":null,"abstract":"Sonar sensors play an integral part in underwater robotic perception by providing imagery at long distances where standard optical cameras cannot. They have proven to be an important part in various robotic algorithms including localization, mapping, and structure from motion. Unfortunately, generating realistic sonar imagery for algorithm development is difficult due to the high cost of field trials and lack of simulation methods. To remove these obstacles, we present various upgrades to the sonar simulation method in HoloOcean, our open-source marine robotics simulator. In particular, we improve the noise modeling using a novel cluster-based multipath ray-tracing algorithm, various probabilistic noise models, and material dependence. We also develop and integrate simulated models for side-scan, single-beam, and multibeam profiling sonars.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"127 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130881807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Novel Human-Safe Robotic Gripper: An application of a Programmable Permanent Magnet Actuator","authors":"Chandramouly Ulagaoozhian, Vincent Duchaine","doi":"10.1109/IROS47612.2022.9981155","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9981155","url":null,"abstract":"While collaborative robotic arms offer significant safety benefits, safety of the overall manipulator system cannot be guaranteed unless equally strict safety requirements are satisfied by the accompanying end-effector. Current robot grippers are not made in a way that fulfills such a requirement, resulting in collaborative robots needing to operate in a protected environment. This paper presents a novel permanent magnet actuator inside of a conventional industrial electric gripper which results in an end-effector that has an unmatched force range of 1-2N to 43N and exhibits interesting characteristics suited to the requirements of a safe gripper such as torque holding without power, variable stiffness and force sensing.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131168317","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Arincheyan Gerald, Rukaiya Batliwala, J. Ye, Patra Hsu, H. Aihara, S. Russo
{"title":"A Soft Robotic Haptic Feedback Glove for Colonoscopy Procedures","authors":"Arincheyan Gerald, Rukaiya Batliwala, J. Ye, Patra Hsu, H. Aihara, S. Russo","doi":"10.1109/IROS47612.2022.9981652","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9981652","url":null,"abstract":"This paper presents a proof-of-concept soft robotic glove that provides haptic feedback to the surgeon's hand during interventional endoscopy procedures, specifically colonoscopy. The glove is connected to a force sensing soft robotic sleeve that is mounted onto a colonoscope. The glove consists of pneumatic actuators that inflate in proportion to the incident forces on the soft robotic sleeve. Thus, the glove is capable of alerting the surgeon of potentially dangerous forces exerted on the colon wall by the colonoscope during the navigation. The proposed glove is adaptable to a variety of hand sizes. It features modular actuators that facilitate convenient and rapid assembly and attachment before the procedure and removal afterward. The glove is calibrated to respond to incident forces on the soft robotic sleeve ranging from 0–3 N. The glove's actuators are able to reach an internal pressure of 53 kPa and exert forces up to 20 N, thereby relaying and amplifying the force exerted by the colonoscope on the colon to the surgeon's hand.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"87 10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130952892","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"E-TRoll: Tactile Sensing and Classification via A Simple Robotic Gripper for Extended Rolling Manipulations","authors":"Xiaoxia Zhou, A. Spiers","doi":"10.1109/IROS47612.2022.9982191","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9982191","url":null,"abstract":"Robotic tactile sensing provides a method of recognizing objects and their properties where vision fails. Prior work on tactile perception in robotic manipulation has frequently focused on exploratory procedures (EPs). However, the also-human-inspired technique of in-hand-manipulation can glean rich data in a fraction of the time of EPs. We propose a simple 3-DOF robotic hand design, optimized for object rolling tasks via a variable-width palm and associated control system. This system dynamically adjusts the distance between the finger bases in response to object behavior. Compared to fixed finger bases, this technique significantly increases the area of the object that is exposed to finger-mounted tactile arrays during a single rolling motion (an increase of over 60% was observed for a cylinder with a 30-millimeter diameter). In addition, this paper presents a feature extraction algorithm for the collected spatiotemporal dataset, which focuses on object corner identification, analysis, and compact representation. This technique drastically reduces the dimensionality of each data sample from $boldsymbol{10times 1500}$ time series data to 80 features, which was further reduced by Principal Component Analysis (PCA) to 22 components. An ensemble subspace k-nearest neighbors (KNN) classification model was trained with 90 observations on rolling three different geometric objects, resulting in a three-fold cross-validation accuracy of 95.6% for object shape recognition.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"69 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133363369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Qiwei Xu, Yizheng Zhang, Shenmin Zhang, Rui Zhao, Z. Wu, Dongsheng Zhang, Cheng Zhou, Xiong Li, Jiahong Chen, Zengjun Zhao, Luyang Tang, Zhengyou Zhang, Lei Han
{"title":"RECCraft System: Towards Reliable and Efficient Collective Robotic Construction","authors":"Qiwei Xu, Yizheng Zhang, Shenmin Zhang, Rui Zhao, Z. Wu, Dongsheng Zhang, Cheng Zhou, Xiong Li, Jiahong Chen, Zengjun Zhao, Luyang Tang, Zhengyou Zhang, Lei Han","doi":"10.1109/IROS47612.2022.9982068","DOIUrl":"https://doi.org/10.1109/IROS47612.2022.9982068","url":null,"abstract":"This research presents a novel Collective Robotic Construction (CRC) system named RECCraft. The RECCraft hardware system is composed of the mobile manipulation vehicles, the cubic blocks, and the folding ramp blocks. Solid connection and easy removal of the blocks are achieved by an electropermanent magnet and silicon steel sheets. With one degree of freedom (DOF) lifting manipulator, the robot can carry a block 3.7 times its volume. An active folding ramp block can provide a robust passage to the upper level for the robot. Our study focuses on systemic improvement of the construction speed and reliability of the robotic construction system. Visual perception system realized by Apritag is adopted, featured by convenient deployment and high precision, to provide a reliable guarantee for robotic construction. RL-based planner provides end-to-end solution for planning tasks of building multi-layer constructions, which is validated by simulation platform and real prototype. Compared with construction speed of existing robotic construction systems, our proposed RECCraft system achieves state-of-the-art level. The robot builds a 2-layer construction by RL-based planner in 4 minutes and 16 seconds, which achieves construction volumetric throughput of 6.7×105 mm3/s.","PeriodicalId":431373,"journal":{"name":"2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)","volume":"16 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2022-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133390873","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}