H. Arie, T. Endo, Takafumi Arakaki, S. Sugano, J. Tani
{"title":"Creating novel goal-directed actions using chaotic dynamics","authors":"H. Arie, T. Endo, Takafumi Arakaki, S. Sugano, J. Tani","doi":"10.1109/DEVLRN.2009.5175521","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175521","url":null,"abstract":"The present study examines the possible roles of cortical chaos in generating novel actions for achieving specified goals. The proposed neural network model consists of a sensory-forward model responsible for parietal lobe functions, a chaotic network model for premotor functions and prefrontal cortex model responsible for manipulating the initial state of the chaotic network. Experiments using humanoid robot were performed with the model and showed that the action plans for satisfying specific novel goals can be generated by diversely modulating and combining prior-learned behavioral patterns at critical dynamical states. Although this criticality resulted in fragile goal achievements in the physical environment of the robot, the reinforcement of the successful trials was able to provide a substantial gain with respect to the robustness. The discussion leads to the hypothesis that the consolidation of numerous sensory-motor experiences into the memory, meditating diverse imagery in the memory by cortical chaos, and repeated enaction and reinforcement of newly generated effective trials are indispensable for realizing an open-ended development of cognitive behaviors.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133688480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development process of functional hierarchy for actions and motor imagery","authors":"Ryunosuke Nishimoto, J. Tani","doi":"10.1109/DEVLRN.2009.5175507","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175507","url":null,"abstract":"The current paper shows a neuro-Robotics experiment on developmental learning of goal-directed actions. The robot was trained to predict visuo-proprioceptive flow of achieving a set of goal-directed behaviors through iterative tutor training processes. The learning was conducted by employing a dynamic neural network model which is characterized by their multiple time-scales dynamics. The experimental results showed that functional hierarchical structures emerge through stages of developments where behavior primitives are generated in earlier stages and their sequences of achieving goals appear later stages. It was also observed that motor imagery is generated in earlier stages compared to actual behaviors. Our claim that manipulatable inner representation should emerge through the sensorymotor interactions is corresponded to Piaget's constructivist view.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127601704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Temporal information as top-down context in binocular disparity detection","authors":"M. Solgi, J. Weng","doi":"10.1109/DEVLRN.2009.5175533","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175533","url":null,"abstract":"Recently, it has been shown that motor initiated context through top-down connections boosts the performance of network models in object recognition applications. Moreover, models of the 6-layer architecture of the laminar cortex have been shown to have computational advantage over single-layer models of the cortex. In this study, we present a temporal model of the laminar cortex that applies expectation feedback signals as top-down temporal context in a binocular network supervised to learn disparities. The work reported here shows that the 6-layer architecture drastically reduced the disparity detection error by as much as 7 times with context enabled. Top-down context reduced the error by a factor of 2 in the same 6-layer architecture. For the first time, an end-to-end model inspired by the 6-layer architecture with emergent binocular representation has reached a sub-pixel accuracy in the challenging problem of binocular disparity detection from natural images. In addition, our model demonstrates biologically-plausible gradually changing topographic maps; the representation of disparity sensitivity changes smoothly along the cortex.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"151 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122961514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Computational benefits of social learning mechanisms: Stimulus enhancement and emulation","authors":"M. Cakmak, N. DePalma, R. Arriaga, A. Thomaz","doi":"10.1109/DEVLRN.2009.5175528","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175528","url":null,"abstract":"Social learning in robotics has largely focused on imitation learning. In this work, we take a broader view of social learning and are interested in the multifaceted ways that a social partner can influence the learning process. We implement stimulus enhancement and emulation on a robot, and illustrate the computational benefits of social learning over individual learning. Additionally we characterize the differences between these two social learning strategies, showing that the preferred strategy is dependent on the current behavior of the social partner. We demonstrate these learning results both in simulation and with physical robot ‘playmates’.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124364534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Robust intrinsically motivated exploration and active learning","authors":"Adrien Baranes, Pierre-Yves Oudeyer","doi":"10.1109/DEVLRN.2009.5175525","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175525","url":null,"abstract":"IAC was initially introduced as a developmental mechanism allowing a robot to self-organize developmental trajectories of increasing complexity without pre-programming the particular developmental stages. In this paper, we argue that IAC and other intrinsically motivated learning heuristics could be viewed as active learning algorithms that are particularly suited for learning forward models in unprepared sensorimotor spaces with large unlearnable subspaces. Then, we introduce a novel formulation of IAC, called R-IAC, and show that its performances as an intrinsically motivated active learning algorithm are far superior to IAC in a complex sensorimotor space where only a small subspace is neither unlearnable nor trivial. We also show results in which the learnt forward model is reused in a control scheme.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130560187","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Surprise-based developmental learning and experimental results on robots","authors":"N. Ranasinghe, Wei-Min Shen","doi":"10.1109/DEVLRN.2009.5175513","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175513","url":null,"abstract":"Learning from surprises and unexpected situations is a capability that is critical for developmental learning. This paper describes a promising approach in which a learner robot engages in a cyclic learning process consisting of “prediction, action, observation, analysis (of surprise) and adaptation”. In particular, the robot always predicts the consequences of its actions, detects surprises whenever there is a significant discrepancy between the prediction and the observed reality, analyzes the surprises for causes, and uses the analyzed knowledge to adapt to the unexpected situations. We tested this approach on a modular robot learning how to navigate and recover from unexpected changes in sensors, actions, goals, and environments. The results are very encouraging.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130006349","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"From bottom-Up visual attention to robot action learning","authors":"Y. Nagai","doi":"10.1109/DEVLRN.2009.5175517","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175517","url":null,"abstract":"This research addresses the challenge of developing an action learning model employing bottom-up visual attention. Although bottom-up attention enables robots to autonomously explore the environment, learn to recognize objects, and interact with humans, the instability of their attention as well as the poor quality of the information detected at the attentional location has hindered the robots from processing dynamic movements. In order to learn actions, robots have to stably attend to the relevant movement by ignoring noises while maintaining sensitivity to a new important movement. To meet these contradictory requirements, I introduce mechanisms for retinal filtering and stochastic attention selection inspired by human vision. The former reduces the complexity of the peripheral vision and thus enables robots to focus more on the currently-attended location. The latter allows robots to flexibly shift their attention to a new prominent location, which must be relevant to the demonstrated action. The signals detected at the attentional location are then enriched based on the spatial and temporal continuity so that robots can learn to recognize objects, movements, and their associations. Experimental results show that the proposed system can extract key actions from human action demonstrations.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"23 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128320926","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Learning and use of sensorimotor schemata maps","authors":"C. Glaser, F. Joublin, C. Goerick","doi":"10.1109/DEVLRN.2009.5175509","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175509","url":null,"abstract":"In this paper we present a framework for the learning and use of sensorimotor schemata. Therefore, we introduce the concept of a schema as a compact representation of an attractor dynamic and discuss how schemata, if embedded into the proposed architecture, can be used to produce, simulate, or recognize goal-directed behaviors. We further present a first implementation of the framework which incorporates well-founded biological principles. Firstly, we apply population coding for the representation of schemata in a neural map and, secondly, we use basis functions as flexible intermediate representations for sensorimotor transformations. Simulation results show that during an initial motor babbling phase the system is able to autonomously develop schemata which correspond to generic behaviors. Moreover, the learned sensorimotor schemata map is topologically ordered insofar as neighboring schemata represent similar behaviors. In accordance with biological findings on the motor system of vertebrates the schemata form a set of behavior primitives which can be flexibly combined to yield more complex behaviors.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116430076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A noise-induced stability in the real-time robotic system for object handling","authors":"H. Wagatsuma","doi":"10.1109/DEVLRN.2009.5175538","DOIUrl":"https://doi.org/10.1109/DEVLRN.2009.5175538","url":null,"abstract":"In various engineering fields, separation between signal and noise is one of the important issues for the robustness of systems that are working in the real environment, and the noise reduction has been discussed when designing a robust system. On the other hand, some researches reported that adding a noise contributes to having multiple internal states and enhancing a transition between the states in the case of non-linear and biological systems, such as the stochastic resonance. It leads to a hypothesis of neuro-mimetic models in which the noise enhances their performance. We have developed the robotic platform as a combination between the real-time simulator of neural dynamics and the robotic device operating in the real world. According to communicative interruptions and time lags, the real-time simulator has the limitation in ability to control the robot, especially in time domain. The robot frequently fails in making an action with respect to the previous sensor data if the calculation is done in the proper timing, providing a deadlock behavior. We here investigated the effect of the noise induction for escaping the deadlock and completion of the ball-handling task, and reported that a self-biased noise helps a enlargement of the range of delay in the system for exhibiting proper performances. By focusing on the temporal aspect of the noise effect in non-linear systems, our research approach may benefit to the implementation and development of biological models in the real system.","PeriodicalId":192225,"journal":{"name":"2009 IEEE 8th International Conference on Development and Learning","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2009-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125649815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}