{"title":"使用强化学习和人工神经网络模拟格斗游戏中的人类行为","authors":"Matheus R. F. Mendonça, H. Bernardino, R. F. Neto","doi":"10.1109/SBGames.2015.25","DOIUrl":null,"url":null,"abstract":"The study of intelligent agent training is of great interest to the gaming industry due to its wide application in various game genres and its capabilities of simulating a human-like behavior. In this work two machine learning techniques, namely, a reinforcement learning approach and an Artificial Neural Network (ANN), are used in a fighting game in order to allow the agent/fighter to emulate a human player. We propose a special reward function for the reinforcement learning approach that is capable of integrating specific human-like behaviors to the agent. The ANN is trained with several recorded battles of a human player. The proposed methods are compared to other two reinforcement learning methods presented in the literature. Furthermore, we present a detailed discussion of the empirical evaluations performed, regarding the training process and the main characteristics of each method used. The results obtained in the experiments indicated that the proposed methods have a good performance against human players and are also more enjoyable to play against when compared to the other existing methods.","PeriodicalId":102706,"journal":{"name":"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"17","resultStr":"{\"title\":\"Simulating Human Behavior in Fighting Games Using Reinforcement Learning and Artificial Neural Networks\",\"authors\":\"Matheus R. F. Mendonça, H. Bernardino, R. F. Neto\",\"doi\":\"10.1109/SBGames.2015.25\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The study of intelligent agent training is of great interest to the gaming industry due to its wide application in various game genres and its capabilities of simulating a human-like behavior. In this work two machine learning techniques, namely, a reinforcement learning approach and an Artificial Neural Network (ANN), are used in a fighting game in order to allow the agent/fighter to emulate a human player. We propose a special reward function for the reinforcement learning approach that is capable of integrating specific human-like behaviors to the agent. The ANN is trained with several recorded battles of a human player. The proposed methods are compared to other two reinforcement learning methods presented in the literature. Furthermore, we present a detailed discussion of the empirical evaluations performed, regarding the training process and the main characteristics of each method used. The results obtained in the experiments indicated that the proposed methods have a good performance against human players and are also more enjoyable to play against when compared to the other existing methods.\",\"PeriodicalId\":102706,\"journal\":{\"name\":\"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)\",\"volume\":\"35 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"17\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/SBGames.2015.25\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 14th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/SBGames.2015.25","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Simulating Human Behavior in Fighting Games Using Reinforcement Learning and Artificial Neural Networks
The study of intelligent agent training is of great interest to the gaming industry due to its wide application in various game genres and its capabilities of simulating a human-like behavior. In this work two machine learning techniques, namely, a reinforcement learning approach and an Artificial Neural Network (ANN), are used in a fighting game in order to allow the agent/fighter to emulate a human player. We propose a special reward function for the reinforcement learning approach that is capable of integrating specific human-like behaviors to the agent. The ANN is trained with several recorded battles of a human player. The proposed methods are compared to other two reinforcement learning methods presented in the literature. Furthermore, we present a detailed discussion of the empirical evaluations performed, regarding the training process and the main characteristics of each method used. The results obtained in the experiments indicated that the proposed methods have a good performance against human players and are also more enjoyable to play against when compared to the other existing methods.