{"title":"Reinforcement learning of sensor-based reaching strategies for a two-link manipulator","authors":"P. Martín, J. Millán","doi":"10.1109/IROS.1996.568991","DOIUrl":"https://doi.org/10.1109/IROS.1996.568991","url":null,"abstract":"This paper presents a neural controller that learns goal-oriented obstacle-avoiding reaction strategies for a multilink robot arm. It acquires these strategies through reinforcement learning from local sensory data. The robot arm has rings of range sensors placed along its links. The neural controller achieves a good performance quite rapidly and shows good generalization abilities in the face of new environments. Suitable input and output codification schemes help greatly to attain these aims. The input codification exploits the inherent symmetry of the robot kinematics and the action given by the controller is interpreted with regard to the shortest path vector (SPV) to the closest goal in the configuration space. In order to avoid the SPV computation for multilink manipulators, we put forward the use of a module for differential inverse kinematics based on the inversion of a neural network that has been previously trained to approximate the manipulator forward kinematics. The use of this module does not only get round the SPV calculation, but also speeds up the learning process.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121827246","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A visual tracking algorithm by integrating rigid model and snakes","authors":"D. Kang, In-So Kweon","doi":"10.1109/IROS.1996.571051","DOIUrl":"https://doi.org/10.1109/IROS.1996.571051","url":null,"abstract":"This paper presents a robust vision algorithm for tracking the boundary of an object with an arbitrary shape by using monocular image sequences. This method consists of a curve registration based optimization technique and a deformable contour model (\"snakes\") for the global and the local motion estimations, respectively. By combining techniques, we overcome, among other problems, inaccurate estimate of motion parameters in the curve registration method (which apparently only occur when a rigid or a flexible object is tracked), and the \"local position variation\" of the deformable contour model, variations, which are due to noisy images and/or complex backgrounds. The curve registration method uses an iterative algorithm to find the minimum normal distance between two curves, one before motion and the corresponding curve after it. Snakes overcome the limitation of the curve registration method, which suffers from the inaccuracy of motion models. We also propose an internal force, which increases local robustness of the deformable contour to background noise. By using the refined snakes' control points, the global update of the previous curve is performed for the re-location of the registered curve. Additionally, we integrate the geometric invariant value of the boundary contour and the curve registration method to solve the occlusion problem in visual tracking. The proposed method is validated through experiments on real images.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"52 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127353982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Gesture recognition of head motion using range images","authors":"K. Umeda, Norihito Suzuki","doi":"10.1109/IROS.1996.569025","DOIUrl":"https://doi.org/10.1109/IROS.1996.569025","url":null,"abstract":"Gesture recognition using images is recently studied as a technology of human friendly man-machine interface. In this paper recognition of 3D gesture by using range images is discussed. Two methods for recognizing head motion from a sequence of range images are proposed One method uses differential range images. Vertically/horizontally weighted averages of the difference values are utilized and 'Yes' motion is robustly identified. The other method detects and tracks nose position. 'Yes'/'No' motions are identified by the vertical/horizontal amplitude of vibration. Experiments to recognize a person's gesture using a range sensor system are performed to show the effectiveness of the methods.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124976172","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Halme, P. Appelqvist, P. Jakubik, P. Kähkönen, Torsten Schönberg, M. Vainio
{"title":"Bacterium Robot Society-A biologically inspired multi-agent concept for internal monitoring and controlling of processes","authors":"A. Halme, P. Appelqvist, P. Jakubik, P. Kähkönen, Torsten Schönberg, M. Vainio","doi":"10.1109/IROS.1996.569041","DOIUrl":"https://doi.org/10.1109/IROS.1996.569041","url":null,"abstract":"Societies are formed as collaborative structures to execute tasks that are not possible or are difficult for individuals alone. There are many types of biological societies formed by animals, but societies formed by machines or robots are still rare. This paper introduces the concept of an application oriented robot society formed by autonomous underwater robots. The Bacterium Robot Society is a generic concept with many potential applications. As an example of such application a scenario, where robot society serves as a mobile distributed sensor instrument inside a process plant, is presented.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125684529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptive criteria for biped dynamic stability under external perturbations","authors":"O. Vanel, P. Gorce","doi":"10.1109/IROS.1996.570664","DOIUrl":"https://doi.org/10.1109/IROS.1996.570664","url":null,"abstract":"In this paper, we propose an approach, called real time criteria and constraints adaptation, which allows one to solve the dynamic stability problem in multi-chains mechanisms field. Our approach is applied to the dynamic stability of a biped robot called BIPMAN. This relies on the analysis of position, velocity and acceleration vectors for criterion real time adaptation and on forces analysis for constraints real time adaptation. The general criterion retained allows one to optimize the force distribution as well as trunk roll and pitch angles. Ponderation coefficients are introduced into this general criterion in order to specify criteria adapted to specific classes of tasks. Many results are presented to demonstrate the criteria and constraints influences on dynamic stability and finally to validate the RTCA approach for a specific task.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"118 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116209753","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adaptive time step for fast converging dynamic simulation system","authors":"A. Joukhadar, C. Laugier","doi":"10.1109/IROS.1996.570806","DOIUrl":"https://doi.org/10.1109/IROS.1996.570806","url":null,"abstract":"Dynamic simulation can be a powerful tool for the study of complex contact interactions between robots and their environments, but a large amount of computation is often required to generate numerically accurate simulations. This paper describes an adaptive time step approach to dynamical simulation based on monitoring the conservation of energy. This approach allows us to insure numerical stability and computational efficiency at a very low computational overhead, and also provides estimates of the probable range of numerical errors in position and velocity. The approach is applicable to any physical-based dynamic simulation system and can be integrated with other optimization techniques.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"199 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122558975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A paradigm of bounded geometry for the singularities avoidance of redundant manipulators","authors":"R. Mayorga","doi":"10.1109/IROS.1996.570810","DOIUrl":"https://doi.org/10.1109/IROS.1996.570810","url":null,"abstract":"In this article a bounded geometry paradigm for the singularities avoidance of redundant manipulators is presented. Such a paradigm enables the development of fast and robust algorithms. The approach is based on establishing appropriate bounds for the norm of some characterizing matrices, representing some geometrical concepts, in order to obtain some performance indices for singularities avoidance and robust path generation.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121865984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"New skill learning paradigm using various kinds of neurons","authors":"T. Eom, Sung-Woo Kim, Changkyu Choi, Jujang Lee","doi":"10.1109/IROS.1996.568965","DOIUrl":"https://doi.org/10.1109/IROS.1996.568965","url":null,"abstract":"Modeled from human neurons, various types of artificial neurons are developed and applied to control algorithm. In this paper, the weights and structure of feedforward neural network controller are updated using new skill learning paradigm which consists of supervisory controller, chaotic neuron filter and associative memory. The pattern of system nonlinearity along the desired path is extracted while supervisory controller guarantees stability in the sense of the boundedness of tracking error. Next the pattern is divided into small segments and encoded to bipolar codes depending on the existence of critical points. Comparing the encoded pattern with pre-stored neural parameters and pattern pairs through associative memory, the most similar one is obtained. Also, chaotic neuron filter is used to add perturbation to neural parameters when the training of feedforward neural network is not successful with the pre-stored parameters. Finally the memory is updated with new successful parameters and pattern pairs. Simulation is performed for simple two-link robot in case of the slight modification of desired trajectory.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"178 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128273975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Preliminary results on grasping with vision and touch","authors":"J. Son, R. Howe, Jonathan G. Wang, Gregory Hager","doi":"10.1109/IROS.1996.568952","DOIUrl":"https://doi.org/10.1109/IROS.1996.568952","url":null,"abstract":"This paper presents initial results in integrating touch with vision for delicate manipulation tasks. A generalizable framework of behavioral primitives for tactile and visual feedback control is proposed. Since vision provides position and shape information at a distance, while tactile provides small-scale geometric and force information, we focus on the complimentary roles of vision and touch. We demonstrate that visual feedback can perform the rough positioning needed for tactile sensor feedback, and that grasp force and object orientation can be sensed and controlled with tactile sensing. A force sensor based approach provides a comparison measure, and we observe that the use of tactile sensing results in a more gentle grasp.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128359902","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development of a two-armed bipedal robot that can walk and carry objects","authors":"F. Kanehiro, M. Inaba, H. Inoue","doi":"10.1109/IROS.1996.570617","DOIUrl":"https://doi.org/10.1109/IROS.1996.570617","url":null,"abstract":"We have focused on actions of a humanlike robot which has the whole body and realized actions such as \"walk\", \"roll over\" and \"stand up\". In this research, we design and implement the whole body humanlike robot that can perform a \"carry objects\" action. Keys to realizing a carrying action are (1) the robot system which has a lightweight whole body robot and a powerful brain which can process a multi joint model of the body, (2) the model environment which can generate walking patterns on the horizontal ground, stairs and a slope by moving its centroid and (3) gravity compensation based on modeling of the actuator.","PeriodicalId":374871,"journal":{"name":"Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1996-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129154399","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}