使用强化学习和人工神经网络模拟格斗游戏中的人类行为

Matheus R. F. Mendonça, H. Bernardino, R. F. Neto
{"title":"使用强化学习和人工神经网络模拟格斗游戏中的人类行为","authors":"Matheus R. F. Mendonça, H. Bernardino, R. F. Neto","doi":"10.1109/SBGames.2015.25","DOIUrl":null,"url":null,"abstract":"The study of intelligent agent training is of great interest to the gaming industry due to its wide application in various game genres and its capabilities of simulating a human-like behavior. In this work two machine learning techniques, namely, a reinforcement learning approach and an Artificial Neural Network (ANN), are used in a fighting game in order to allow the agent/fighter to emulate a human player. We propose a special reward function for the reinforcement learning approach that is capable of integrating specific human-like behaviors to the agent. The ANN is trained with several recorded battles of a human player. The proposed methods are compared to other two reinforcement learning methods presented in the literature. Furthermore, we present a detailed discussion of the empirical evaluations performed, regarding the training process and the main characteristics of each method used. The results obtained in the experiments indicated that the proposed methods have a good performance against human players and are also more enjoyable to play against when compared to the other existing methods.","PeriodicalId":102706,"journal":{"name":"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"17","resultStr":"{\"title\":\"Simulating Human Behavior in Fighting Games Using Reinforcement Learning and Artificial Neural Networks\",\"authors\":\"Matheus R. F. Mendonça, H. Bernardino, R. F. Neto\",\"doi\":\"10.1109/SBGames.2015.25\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The study of intelligent agent training is of great interest to the gaming industry due to its wide application in various game genres and its capabilities of simulating a human-like behavior. In this work two machine learning techniques, namely, a reinforcement learning approach and an Artificial Neural Network (ANN), are used in a fighting game in order to allow the agent/fighter to emulate a human player. We propose a special reward function for the reinforcement learning approach that is capable of integrating specific human-like behaviors to the agent. The ANN is trained with several recorded battles of a human player. The proposed methods are compared to other two reinforcement learning methods presented in the literature. Furthermore, we present a detailed discussion of the empirical evaluations performed, regarding the training process and the main characteristics of each method used. The results obtained in the experiments indicated that the proposed methods have a good performance against human players and are also more enjoyable to play against when compared to the other existing methods.\",\"PeriodicalId\":102706,\"journal\":{\"name\":\"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)\",\"volume\":\"35 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"17\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SBGames.2015.25\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SBGames.2015.25","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 17

摘要

智能代理训练的研究是游戏行业非常感兴趣的,因为它广泛应用于各种游戏类型和模拟人类行为的能力。在这项工作中,两种机器学习技术,即强化学习方法和人工神经网络(ANN),用于格斗游戏中,以允许代理/战士模仿人类玩家。我们为强化学习方法提出了一个特殊的奖励函数,它能够将特定的类人行为集成到代理中。人工神经网络是用人类玩家的几场战斗记录来训练的。将所提出的方法与文献中提出的其他两种强化学习方法进行了比较。此外,我们对所进行的经验评估进行了详细的讨论,包括培训过程和所使用的每种方法的主要特征。实验结果表明,本文提出的方法在对抗人类棋手时具有良好的性能,与其他现有方法相比,也更加有趣。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Simulating Human Behavior in Fighting Games Using Reinforcement Learning and Artificial Neural Networks
The study of intelligent agent training is of great interest to the gaming industry due to its wide application in various game genres and its capabilities of simulating a human-like behavior. In this work two machine learning techniques, namely, a reinforcement learning approach and an Artificial Neural Network (ANN), are used in a fighting game in order to allow the agent/fighter to emulate a human player. We propose a special reward function for the reinforcement learning approach that is capable of integrating specific human-like behaviors to the agent. The ANN is trained with several recorded battles of a human player. The proposed methods are compared to other two reinforcement learning methods presented in the literature. Furthermore, we present a detailed discussion of the empirical evaluations performed, regarding the training process and the main characteristics of each method used. The results obtained in the experiments indicated that the proposed methods have a good performance against human players and are also more enjoyable to play against when compared to the other existing methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信