{"title":"Programming by Visual Demonstration for Pick-and-Place Tasks using Robot Skills","authors":"Peng Hao, Tao Lu, Yinghao Cai, Shuo Wang","doi":"10.1109/ROBIO49542.2019.8961481","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961481","url":null,"abstract":"In this paper, we present a vision-based robot programming system for pick-and-place tasks that can generate programs from human demonstrations. The system consists of a detection network and a program generation module. The detection network leverages convolutional pose machines to detect the key-points of the objects. The network is trained in a simulation environment in which the train set is collected and auto-labeled. To bridge the gap between reality and simulation, we propose a design method of transform function for mapping a real image to synthesized style. Compared with the unmapped results, the Mean Absolute Error (MAE) of the model completely trained with synthesized images is reduced by 23% and the False Negative Rate FNR (FNR) of the model fine-tuned by the real images is reduced by 42.5% after mapping. The program generation module provides a human-readable program based on the detection results to reproduce a real-world demonstration, in which a longshort memory (LSM) is designed to integrate current and historical information. The system is tested in the real world with a UR5 robot on the task of stacking colored cubes in different orders.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131417193","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
T. Shimura, Yuta Murai, Shunta Togo, Yinlai Jiang, H. Yokoi
{"title":"Lightweight 10-DOF Robotic Hand With Built-In Wire-Driven Mechanism","authors":"T. Shimura, Yuta Murai, Shunta Togo, Yinlai Jiang, H. Yokoi","doi":"10.1109/ROBIO49542.2019.8961530","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961530","url":null,"abstract":"The purpose of EMG prosthetic hands is to compensate for the lost functions of hand amputees. To restore the ability to perform activities in daily life, prosthetic hands need to have as many a degrees of freedom (DOFs) as possible. Furthermore, this requirement must be realized while retaining grasping stability and keeping the hand light in weight and small in size. In this study, our aim is to develop a 10-DOF hand that can form the seven finger postures that are required for daily life activities. To achieve this objective, we propose a wire-driven mechanism built over a finger skeleton and implemented it on a hand. We confirm that the developed hand can achieve all of the goal actions. In addition, our developed hand was evaluated using two indices, rate of controllability and rate of weight, as defined in this research.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131753037","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Clutter Filtering Algorithm in Dense Clutter Environment","authors":"Sheng Mou, Jianhui Guo","doi":"10.1109/ROBIO49542.2019.8961873","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961873","url":null,"abstract":"Multi-Target Tracking (MTT) in dense clutter environment has always been a research difficulty in the field of radar target tracking, the key is to effectively combine state filtering with data association. In the dense clutter environment, in addition to the echo of the target point, there are also a large number of clutter interference from unknown scatters, so it is difficult to process the data. In this paper, we propose a clutter filtering algorithm in dense clutter environment based on Track-Oriented Multiple Hypothesis Tracking (TOMHT) and Support Vector Machine (SVM), which is used to filter clutters, and to provide prior environmental information for subsequent target tracking. It reduces the density of clutter and improves the efficiency of data association under the premise of satisfying the tracking accuracy. The results show that the algorithm can effectively suppress clutter and improve tracking performance.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"140 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116530176","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Daxing Chen, Xinghao Song, Shixi Fan, Hongpeng Wang
{"title":"An Attention Module for Multi-Person Pose Estimation","authors":"Daxing Chen, Xinghao Song, Shixi Fan, Hongpeng Wang","doi":"10.1109/ROBIO49542.2019.8961623","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961623","url":null,"abstract":"In the top-down approaches of multi-person pose estimation, a human detector is adopted first to generate a set of human bounding boxes, then crop these human body and perform a single-person pose estimation model to get the final result. However, some body part of another person on the cropped image will interfere the single-person pose estimation model leading to an inaccuracy result. In order to model the relationship between adjacent keypoints effectively to alleviate this problem, we propose and attention module that could let the model get global receptive field at the shallow layer of the network and pay more attention to the key areas which is more important to pose estimation. Experiment results show that our method achieves 73.9% mAP with 2.4% absolute improvement compared to our baseline on the COCO test-dev dataset.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"1924 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128014535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Delong Zhu, Jianbang Liu, Nachuan Ma, Z. Min, M. Meng
{"title":"Autonomous Removal of Perspective Distortion for Robotic Elevator Button Recognition","authors":"Delong Zhu, Jianbang Liu, Nachuan Ma, Z. Min, M. Meng","doi":"10.1109/ROBIO49542.2019.8961720","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961720","url":null,"abstract":"Elevator button recognition is considered an indispensable function for enabling the autonomous elevator operation of mobile robots. However, due to unfavorable image conditions and various image distortions, the recognition accuracy remains to be improved. In this paper, we present a novel algorithm that can autonomously correct perspective distortions of elevator panel images. The algorithm first leverages the Gaussian Mixture Model (GMM) to conduct a grid fitting process based on button recognition results, then utilizes the estimated grid centers as reference features to estimate camera motions for correcting perspective distortions. The algorithm performs on a single image autonomously and does not need explicit feature detection or feature matching procedure, which is much more robust to noises and outliers than traditional feature-based geometric approaches. To verify the effectiveness of the algorithm, we collect an elevator panel dataset of 50 images captured from different angles of view. Experimental results show that the proposed algorithm can accurately estimate camera motions and effectively remove perspective distortions.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"116 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128062419","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Spin-up Control of Tethered Space Station for Artificial Gravity Task*","authors":"Zhengyuan Li, Zhongjie Meng, Panfeng Huang","doi":"10.1109/ROBIO49542.2019.8961375","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961375","url":null,"abstract":"In order to overcome the problems caused by the zero gravity of space, artificial gravity space station has been widely concerned in recent years. The tether-based space station relies on the centrifugal force generated by its rotation around the centroid to simulate gravity, which greatly reduces various problems caused by the zero gravity environment, and has many advantages such as low spin speed, flexibility, and scalability. For the spin-up process of the tethered space station, a dynamic model of the tethered space station based on the Lagrange method is established firstly. Then, the control law using sliding mode theory and the dynamic inversion is proposed. Different spin-up schemes are designed to test the control law. Simulation results shows that whether the system’s tether retraction rate is adjustable or not, the angular velocity of the system can smoothly reach the desired value to produce the expected level of artificial gravity.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"25 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132652626","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"An Modified Real-time Photometric Calibration Algorithm Based on ORB Features*","authors":"Chuanzheng Liu, Jiahui Qi, Cheng-jin Zhang, Peixin Liu, Xianfeng Yuan","doi":"10.1109/ROBIO49542.2019.8961503","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961503","url":null,"abstract":"In order to improve the accuracy of direct visual odometry and SLAM algorithm under illumination changes, we propose an modified real-time photometric calibration algorithm based on ORB features. Firstly, we use more robust ORB features as input to a optimization framework to obtain scene points correspondences. Then, we establish the reprojection pixels intensity residual equation based on photometric image formation and feature matching results of the camera. Finally, the incoming frames are corrected by the camera response function, exposure time and vignetting estimation. The proposed approach is tested with the EuRoC dataset and TUM dataset respectively, and experimental results indicate that the exposure compensation and time cost performances of the proposed method are promising.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"25 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133244361","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Global Path Planning Algorithm for Robots Using Reinforcement Learning","authors":"Penggang Gao, Zihan Liu, Zongkai Wu, Donglin Wang","doi":"10.1109/ROBIO49542.2019.8961753","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961753","url":null,"abstract":"Path planning is the key technology for autonomous mobile robots. In view of the shortage of paths found by traditional best first search (BFS) and rapidly-exploring random trees (RRT) algorithm which are not short and smooth enough for robot navigation, a new global planning algorithm combined with reinforcement learning is presented for robots. In our algorithm, a path graph is established firstly, in which the paths collided with the obstacles are removed directly. Then a collision-free path will be found by Q-Learning from starting point to the goal. The experiment results illustrate that it can generate shorter and smoother paths, compared with the BFS and RRT algorithm.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"235 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133605945","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Sensorless Hybrid Normal-Force Controller With Surface Prediction","authors":"Yingjie Qian, Jianjun Yuan, Sheng Bao, Liming Gao","doi":"10.1109/ROBIO49542.2019.8961532","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961532","url":null,"abstract":"In this paper, an improved sensorless hybrid controller for constant force control along normal direction is proposed for applications including polishing, milling and deburring. No additional sensors are involved. External joint torques of all joints can be calculated from their electric current, dynamic model and friction model. With the help of dynamically consistent generalized inverse matrix, they can be converted to external force/torque at the end-effector. The underlying force control strategy is the integration of impedance control model and explicit force control. The novel improvement is the real-time prediction algorithm of surface’s shape profile and normal direction without any prior knowledge. So, this force controller has great adaptiveness to arbitrary unknown surfaces. Experiments were performed on a 7 degrees-of-freedom (DOFs) robot to test the controller’s capability and utility on an inclined plane and curved surface. Results prove the credibility of external force estimation. The normal force tracking accuracy is adequate for targeted applications. Real-time prediction is functional as the robot adjusts its orientation accordingly.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133906263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Kangshuai Chen, Yanan Zhang, Zhen Zhang, Yu-xian Yang, Hailiang Ye
{"title":"Trans Humeral Prosthesis Based on sEMG and SSVEP-EEG Signals*","authors":"Kangshuai Chen, Yanan Zhang, Zhen Zhang, Yu-xian Yang, Hailiang Ye","doi":"10.1109/ROBIO49542.2019.8961453","DOIUrl":"https://doi.org/10.1109/ROBIO49542.2019.8961453","url":null,"abstract":"The loss of forearm muscle in amputees above elbow joint make it impossible to control the prosthesis of elbow joint and upper limb only by using surface electromyography (sEMG) signals. Electroencephalogram (EEG) signals can be used as input signal to control the motion of the upper limb prosthetic hand for it can reflect the user's motion intention. This paper introduces a method of controlling the trans humeral prosthesis by combining sEMG and EEG signals. In this method, the control of elbow flexion and extension motions are based on sEMG signals of biceps and triceps. Combined with the collected elbow angles, the elbow angle of prosthetic arm is predicted by back propagation neural network after training and then the angle can be used to control the elbow joint. In order to control the motion of the prosthetic hand, a control method based on EEG is proposed. The EEG control method is named as steady state visual evoked potential (SSVEP). User can use his EEG signals to control the motion of hand prosthesis. Canonical correlation analysis (CCA) algorithm is used to classify SSVEP signals, then different SSVEP signals can be used to control different motions of prosthetic hands. Some experiments were carried out on healthy subjects to verify the performance of the proposed system.","PeriodicalId":121822,"journal":{"name":"2019 IEEE International Conference on Robotics and Biomimetics (ROBIO)","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132348846","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}