{"title":"深度主动模仿学习算法在FIFA球员代理动态环境中的性能评价","authors":"Matheus Prado Prandini Faria, Rita Maria Silva Julia, Lidia Bononi Paiva Tomaz","doi":"10.1109/ICMLA.2019.00043","DOIUrl":null,"url":null,"abstract":"Deep Learning is a state-of-the-art approach for machine learning using real-world or realist data. FIFA is a soccer simulation game that provides a very realistic environment, but which has been relatively poorly explored in the context of learned game-playing agents. This paper explores the Deep Active Imitation (DAI) learning strategy applied to a dynamic environment in FIFA game. DAI is a segment of Imitation Learning, which consists of a supervised Deep Learning training strategy where the agents learn by observing and replicating human experts' behavior. Noteworthy here is that such learning strategy has only been validated in static navigation scenarios in the sense that the environment is changed only through the actions of the agent. In this way, the main objective of the present work is to investigate the efficacy of DAI to cope with a dynamic FIFA scenario named confrontation mode. The agents were evaluated in terms of in-game score through tournaments against FIFA's engine. The results show that DAI performs well in the confrontation mode. Thus, this work indicates that such learning strategy can be used to solve complex problems.","PeriodicalId":74528,"journal":{"name":"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications","volume":"214 1","pages":"228-233"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Evaluating the Performance of the Deep Active Imitation Learning Algorithm in the Dynamic Environment of FIFA Player Agents\",\"authors\":\"Matheus Prado Prandini Faria, Rita Maria Silva Julia, Lidia Bononi Paiva Tomaz\",\"doi\":\"10.1109/ICMLA.2019.00043\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deep Learning is a state-of-the-art approach for machine learning using real-world or realist data. FIFA is a soccer simulation game that provides a very realistic environment, but which has been relatively poorly explored in the context of learned game-playing agents. This paper explores the Deep Active Imitation (DAI) learning strategy applied to a dynamic environment in FIFA game. DAI is a segment of Imitation Learning, which consists of a supervised Deep Learning training strategy where the agents learn by observing and replicating human experts' behavior. Noteworthy here is that such learning strategy has only been validated in static navigation scenarios in the sense that the environment is changed only through the actions of the agent. In this way, the main objective of the present work is to investigate the efficacy of DAI to cope with a dynamic FIFA scenario named confrontation mode. The agents were evaluated in terms of in-game score through tournaments against FIFA's engine. The results show that DAI performs well in the confrontation mode. Thus, this work indicates that such learning strategy can be used to solve complex problems.\",\"PeriodicalId\":74528,\"journal\":{\"name\":\"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications\",\"volume\":\"214 1\",\"pages\":\"228-233\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICMLA.2019.00043\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the ... International Conference on Machine Learning and Applications. International Conference on Machine Learning and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMLA.2019.00043","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Evaluating the Performance of the Deep Active Imitation Learning Algorithm in the Dynamic Environment of FIFA Player Agents
Deep Learning is a state-of-the-art approach for machine learning using real-world or realist data. FIFA is a soccer simulation game that provides a very realistic environment, but which has been relatively poorly explored in the context of learned game-playing agents. This paper explores the Deep Active Imitation (DAI) learning strategy applied to a dynamic environment in FIFA game. DAI is a segment of Imitation Learning, which consists of a supervised Deep Learning training strategy where the agents learn by observing and replicating human experts' behavior. Noteworthy here is that such learning strategy has only been validated in static navigation scenarios in the sense that the environment is changed only through the actions of the agent. In this way, the main objective of the present work is to investigate the efficacy of DAI to cope with a dynamic FIFA scenario named confrontation mode. The agents were evaluated in terms of in-game score through tournaments against FIFA's engine. The results show that DAI performs well in the confrontation mode. Thus, this work indicates that such learning strategy can be used to solve complex problems.