Adrien Jauffret, Marwen Belkaid, N. Cuperlier, P. Gaussier, P. Tarroux
{"title":"挫折是机器人导航走向自主和自我完善的一种方式","authors":"Adrien Jauffret, Marwen Belkaid, N. Cuperlier, P. Gaussier, P. Tarroux","doi":"10.1109/DEVLRN.2013.6652540","DOIUrl":null,"url":null,"abstract":"Autonomy and self-improvement capabilities are still challenging in the field of robotics. Allowing a robot to autonomously navigate in wide and unknown environments not only requires a set of robust strategies to cope with miscellaneous situations, but also needs mechanisms of self-assessment for guiding learning and for monitoring strategies. Monitoring strategies requires feedbacks on the behavior's quality, from a given fitness system in order to take correct decisions. In this work, we focus on how an emotional controller can be used to modulate robot behaviors. Following an incremental and constructivist approach, we present a generic neural architecture, based on an online novelty detection algorithm that may be able to evaluate any sensory-motor strategies. This architecture learns contingencies between sensations and actions, giving the expected sensation from the past perception. Prediction error, coming from surprising events, provides a direct measure of the quality of the underlying sensory-motor contingencies involved. We show how a simple emotional controller based on the prediction progress allows the system to regulate its behavior to solve complex navigation tasks and to communicate its disability in deadlock situations. We propose that this model could be a key structure toward self-monitoring. We made several experiments that can account for such properties with different behaviors (road following and place cells based navigation).","PeriodicalId":106997,"journal":{"name":"2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2013-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Frustration as a way toward autonomy and self-improvement in robotic navigation\",\"authors\":\"Adrien Jauffret, Marwen Belkaid, N. Cuperlier, P. Gaussier, P. Tarroux\",\"doi\":\"10.1109/DEVLRN.2013.6652540\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Autonomy and self-improvement capabilities are still challenging in the field of robotics. Allowing a robot to autonomously navigate in wide and unknown environments not only requires a set of robust strategies to cope with miscellaneous situations, but also needs mechanisms of self-assessment for guiding learning and for monitoring strategies. Monitoring strategies requires feedbacks on the behavior's quality, from a given fitness system in order to take correct decisions. In this work, we focus on how an emotional controller can be used to modulate robot behaviors. Following an incremental and constructivist approach, we present a generic neural architecture, based on an online novelty detection algorithm that may be able to evaluate any sensory-motor strategies. This architecture learns contingencies between sensations and actions, giving the expected sensation from the past perception. Prediction error, coming from surprising events, provides a direct measure of the quality of the underlying sensory-motor contingencies involved. We show how a simple emotional controller based on the prediction progress allows the system to regulate its behavior to solve complex navigation tasks and to communicate its disability in deadlock situations. We propose that this model could be a key structure toward self-monitoring. We made several experiments that can account for such properties with different behaviors (road following and place cells based navigation).\",\"PeriodicalId\":106997,\"journal\":{\"name\":\"2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL)\",\"volume\":\"22 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2013-11-04\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DEVLRN.2013.6652540\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DEVLRN.2013.6652540","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Frustration as a way toward autonomy and self-improvement in robotic navigation
Autonomy and self-improvement capabilities are still challenging in the field of robotics. Allowing a robot to autonomously navigate in wide and unknown environments not only requires a set of robust strategies to cope with miscellaneous situations, but also needs mechanisms of self-assessment for guiding learning and for monitoring strategies. Monitoring strategies requires feedbacks on the behavior's quality, from a given fitness system in order to take correct decisions. In this work, we focus on how an emotional controller can be used to modulate robot behaviors. Following an incremental and constructivist approach, we present a generic neural architecture, based on an online novelty detection algorithm that may be able to evaluate any sensory-motor strategies. This architecture learns contingencies between sensations and actions, giving the expected sensation from the past perception. Prediction error, coming from surprising events, provides a direct measure of the quality of the underlying sensory-motor contingencies involved. We show how a simple emotional controller based on the prediction progress allows the system to regulate its behavior to solve complex navigation tasks and to communicate its disability in deadlock situations. We propose that this model could be a key structure toward self-monitoring. We made several experiments that can account for such properties with different behaviors (road following and place cells based navigation).