深度主动模仿学习算法在FIFA球员代理动态环境中的性能评价

Matheus Prado Prandini Faria, Rita Maria Silva Julia, Lidia Bononi Paiva Tomaz
{"title":"深度主动模仿学习算法在FIFA球员代理动态环境中的性能评价","authors":"Matheus Prado Prandini Faria, Rita Maria Silva Julia, Lidia Bononi Paiva Tomaz","doi":"10.1109/ICMLA.2019.00043","DOIUrl":null,"url":null,"abstract":"Deep Learning is a state-of-the-art approach for machine learning using real-world or realist data. FIFA is a soccer simulation game that provides a very realistic environment, but which has been relatively poorly explored in the context of learned game-playing agents. This paper explores the Deep Active Imitation (DAI) learning strategy applied to a dynamic environment in FIFA game. DAI is a segment of Imitation Learning, which consists of a supervised Deep Learning training strategy where the agents learn by observing and replicating human experts' behavior. Noteworthy here is that such learning strategy has only been validated in static navigation scenarios in the sense that the environment is changed only through the actions of the agent. In this way, the main objective of the present work is to investigate the efficacy of DAI to cope with a dynamic FIFA scenario named confrontation mode. The agents were evaluated in terms of in-game score through tournaments against FIFA's engine. The results show that DAI performs well in the confrontation mode. Thus, this work indicates that such learning strategy can be used to solve complex problems.","PeriodicalId":74528,"journal":{"name":"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications","volume":"214 1","pages":"228-233"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Evaluating the Performance of the Deep Active Imitation Learning Algorithm in the Dynamic Environment of FIFA Player Agents\",\"authors\":\"Matheus Prado Prandini Faria, Rita Maria Silva Julia, Lidia Bononi Paiva Tomaz\",\"doi\":\"10.1109/ICMLA.2019.00043\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deep Learning is a state-of-the-art approach for machine learning using real-world or realist data. FIFA is a soccer simulation game that provides a very realistic environment, but which has been relatively poorly explored in the context of learned game-playing agents. This paper explores the Deep Active Imitation (DAI) learning strategy applied to a dynamic environment in FIFA game. DAI is a segment of Imitation Learning, which consists of a supervised Deep Learning training strategy where the agents learn by observing and replicating human experts' behavior. Noteworthy here is that such learning strategy has only been validated in static navigation scenarios in the sense that the environment is changed only through the actions of the agent. In this way, the main objective of the present work is to investigate the efficacy of DAI to cope with a dynamic FIFA scenario named confrontation mode. The agents were evaluated in terms of in-game score through tournaments against FIFA's engine. The results show that DAI performs well in the confrontation mode. Thus, this work indicates that such learning strategy can be used to solve complex problems.\",\"PeriodicalId\":74528,\"journal\":{\"name\":\"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications\",\"volume\":\"214 1\",\"pages\":\"228-233\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICMLA.2019.00043\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMLA.2019.00043","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

深度学习是使用真实世界或现实数据进行机器学习的最先进方法。《FIFA》是一款足球模拟游戏,它提供了一个非常逼真的环境,但在学习游戏代理的背景下,这方面的探索相对较少。本文探讨了深度主动模仿(DAI)学习策略在FIFA游戏动态环境中的应用。人工智能是模仿学习的一个部分,它包括一个有监督的深度学习训练策略,其中智能体通过观察和复制人类专家的行为来学习。值得注意的是,这种学习策略只在静态导航场景中得到验证,因为环境只通过智能体的动作来改变。通过这种方式,本工作的主要目的是研究DAI在应对名为对抗模式的动态FIFA场景中的功效。通过与FIFA引擎的比赛来评估代理的游戏内得分。结果表明,DAI在对抗模式下表现良好。因此,这项工作表明,这种学习策略可以用于解决复杂的问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Evaluating the Performance of the Deep Active Imitation Learning Algorithm in the Dynamic Environment of FIFA Player Agents
Deep Learning is a state-of-the-art approach for machine learning using real-world or realist data. FIFA is a soccer simulation game that provides a very realistic environment, but which has been relatively poorly explored in the context of learned game-playing agents. This paper explores the Deep Active Imitation (DAI) learning strategy applied to a dynamic environment in FIFA game. DAI is a segment of Imitation Learning, which consists of a supervised Deep Learning training strategy where the agents learn by observing and replicating human experts' behavior. Noteworthy here is that such learning strategy has only been validated in static navigation scenarios in the sense that the environment is changed only through the actions of the agent. In this way, the main objective of the present work is to investigate the efficacy of DAI to cope with a dynamic FIFA scenario named confrontation mode. The agents were evaluated in terms of in-game score through tournaments against FIFA's engine. The results show that DAI performs well in the confrontation mode. Thus, this work indicates that such learning strategy can be used to solve complex problems.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信