Improving RL Speed by Adding Unseen Experiences via Operators Inspired by Genetic Algorithm Operators Enriched by Chaotic Random Generator

Mostafa Rafiei, M. Sina
{"title":"Improving RL Speed by Adding Unseen Experiences via Operators Inspired by Genetic Algorithm Operators Enriched by Chaotic Random Generator","authors":"Mostafa Rafiei, M. Sina","doi":"10.1109/MICAI.2015.21","DOIUrl":null,"url":null,"abstract":"In many Multi-Agent Systems, under-education agents investigate their environments to discover their target(s). Any agent can also learn its strategy. In multi-task learning, one agent studies a set of related problems together simultaneously, by a common model. In reinforcement learning exploration phase, it is necessary to introduce a process of trial and error to learn better rewards obtained from environment. To reach this end, anyone can typically employ the uniform pseudorandom number generator in exploration period. On the other hand, it is predictable that chaotic sources also offer a random-like series comparable to stochastic ones. It is useful in multi-task reinforcement learning, to use teammate agents' experience by doing simple interactions between each other. We employ the past experiences of agents to enhance performance of multi-task learning in a nondeterministic environment. Communications are created by operators of evolutionary algorithm. In this paper we have also employed the chaotic generator in the exploration phase of reinforcement learning in a nondeterministic maze problem. We obtained interesting results in the maze problem.","PeriodicalId":448255,"journal":{"name":"2015 Fourteenth Mexican International Conference on Artificial Intelligence (MICAI)","volume":"177 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 Fourteenth Mexican International Conference on Artificial Intelligence (MICAI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MICAI.2015.21","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In many Multi-Agent Systems, under-education agents investigate their environments to discover their target(s). Any agent can also learn its strategy. In multi-task learning, one agent studies a set of related problems together simultaneously, by a common model. In reinforcement learning exploration phase, it is necessary to introduce a process of trial and error to learn better rewards obtained from environment. To reach this end, anyone can typically employ the uniform pseudorandom number generator in exploration period. On the other hand, it is predictable that chaotic sources also offer a random-like series comparable to stochastic ones. It is useful in multi-task reinforcement learning, to use teammate agents' experience by doing simple interactions between each other. We employ the past experiences of agents to enhance performance of multi-task learning in a nondeterministic environment. Communications are created by operators of evolutionary algorithm. In this paper we have also employed the chaotic generator in the exploration phase of reinforcement learning in a nondeterministic maze problem. We obtained interesting results in the maze problem.
由混沌随机发生器丰富的遗传算子启发的算子加入未知经验提高强化学习速度
在许多多智能体系统中,未受教育的智能体调查其环境以发现其目标。任何代理也可以学习自己的策略。在多任务学习中,一个智能体通过一个共同的模型同时研究一组相关的问题。在强化学习探索阶段,有必要引入一个试错过程,以学习从环境中获得更好的奖励。为了达到这一目的,任何人都可以在探索期间使用均匀伪随机数生成器。另一方面,混沌源也可以提供与随机源相当的类随机序列,这是可以预测的。在多任务强化学习中,通过相互之间进行简单的交互来利用队友智能体的经验是很有用的。我们利用智能体过去的经验来提高在不确定性环境下的多任务学习性能。通信是由进化算法的操作者创建的。在本文中,我们还将混沌发生器应用于不确定性迷宫问题的强化学习的探索阶段。我们在迷宫问题中得到了有趣的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信