A Computational Model of Imitation and Autonomous Behavior

Tatsuya Sakato, Motoyuki Ozeki, N. Oka
{"title":"A Computational Model of Imitation and Autonomous Behavior","authors":"Tatsuya Sakato, Motoyuki Ozeki, N. Oka","doi":"10.1109/SNPD.2012.135","DOIUrl":null,"url":null,"abstract":"Learning is essential for an autonomous agent to adapt to an environment. One method that can be used is learning through trial and error. However, it is impractical because of the long learning time required when the agent learns in a complex environment. Therefore, some guidelines are necessary to expedite the learning process in a complex environment. Imitation of the behavior of other agents who have already adapted to the environment would shorten an agent's learning time. Thus, imitation can be used by agents as a guideline for learning. In this study, we propose a computational model of imitation and autonomous behavior. We expect that an agent can reduce its learning time through imitation. The actions that an agent performs are represented by a set of features such as the type, location, and object of an action. The agent tends to imitate the similar actions of other agents, and the similarity between actions is calculated, which is indicative of the importance of each feature. The proposed model is evaluated using a dining table simulator. The experimental results indicate that the proposed model can adapt to the environment faster than a baseline model that learns only through trial and error, and that the proposed model can shorten the learning time further if the importance of each feature can be adjusted by learning.","PeriodicalId":387936,"journal":{"name":"2012 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2012-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2012 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SNPD.2012.135","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

Learning is essential for an autonomous agent to adapt to an environment. One method that can be used is learning through trial and error. However, it is impractical because of the long learning time required when the agent learns in a complex environment. Therefore, some guidelines are necessary to expedite the learning process in a complex environment. Imitation of the behavior of other agents who have already adapted to the environment would shorten an agent's learning time. Thus, imitation can be used by agents as a guideline for learning. In this study, we propose a computational model of imitation and autonomous behavior. We expect that an agent can reduce its learning time through imitation. The actions that an agent performs are represented by a set of features such as the type, location, and object of an action. The agent tends to imitate the similar actions of other agents, and the similarity between actions is calculated, which is indicative of the importance of each feature. The proposed model is evaluated using a dining table simulator. The experimental results indicate that the proposed model can adapt to the environment faster than a baseline model that learns only through trial and error, and that the proposed model can shorten the learning time further if the importance of each feature can be adjusted by learning.
模仿与自主行为的计算模型
学习对于自主代理适应环境至关重要。一种可以使用的方法是通过试错来学习。然而,由于智能体在复杂环境中学习需要很长的学习时间,这是不切实际的。因此,需要一些指导方针来加快复杂环境中的学习过程。模仿已经适应环境的其他智能体的行为会缩短智能体的学习时间。因此,模仿可以被智能体用作学习的指导。在这项研究中,我们提出了一个模仿和自主行为的计算模型。我们期望智能体可以通过模仿来缩短学习时间。代理执行的操作由一组特征表示,例如操作的类型、位置和对象。智能体倾向于模仿其他智能体的相似动作,并计算动作之间的相似度,这表明了每个特征的重要性。利用餐桌模拟器对所提出的模型进行了评估。实验结果表明,该模型比仅通过试错学习的基线模型对环境的适应速度更快,并且如果可以通过学习调整每个特征的重要性,则该模型可以进一步缩短学习时间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信