利用对手建模实现《古代防御2》中的智能代理

Azka Hanif Imtiyaz, Nur Ulfa Maulidevi
{"title":"利用对手建模实现《古代防御2》中的智能代理","authors":"Azka Hanif Imtiyaz, Nur Ulfa Maulidevi","doi":"10.1109/ICAICTA.2018.8541286","DOIUrl":null,"url":null,"abstract":"Intelligent agent is specially suited for completing tasks in video games. Intelligent agent in Dota 2 had been proven to be better at professional human with bot that was developed by OpenAI. Other bots haven’t been able to produce good level of performance as generally bots are developed with rule-based approach. This caused the bot to perform as good as the developer’s understanding of the game. One of learning method to be used in this case is opponent modeling; an attempt at modeling opponent based on its behavior. First, bot will play a round of training match to gather environment data. Model is built based on the data that is gathered with opponent’s current action target as the target regression. Prediction from the model is used in bot for consideration in deciding which action is best against opponent’s action. For validation, implemented bot with opponent modeling faced against bot without opponent modeling and also default bot from Dota 2. The results showed that opponent modeling as a component is able to increase the level of performance on the implemented bot. This showed that opponent modeling is able to provide relevant information for the bot to decide the best action.","PeriodicalId":184882,"journal":{"name":"2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Implementation of Intelligent Agent in Defense of the Ancient 2 through Utilization of Opponent Modeling\",\"authors\":\"Azka Hanif Imtiyaz, Nur Ulfa Maulidevi\",\"doi\":\"10.1109/ICAICTA.2018.8541286\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Intelligent agent is specially suited for completing tasks in video games. Intelligent agent in Dota 2 had been proven to be better at professional human with bot that was developed by OpenAI. Other bots haven’t been able to produce good level of performance as generally bots are developed with rule-based approach. This caused the bot to perform as good as the developer’s understanding of the game. One of learning method to be used in this case is opponent modeling; an attempt at modeling opponent based on its behavior. First, bot will play a round of training match to gather environment data. Model is built based on the data that is gathered with opponent’s current action target as the target regression. Prediction from the model is used in bot for consideration in deciding which action is best against opponent’s action. For validation, implemented bot with opponent modeling faced against bot without opponent modeling and also default bot from Dota 2. The results showed that opponent modeling as a component is able to increase the level of performance on the implemented bot. This showed that opponent modeling is able to provide relevant information for the bot to decide the best action.\",\"PeriodicalId\":184882,\"journal\":{\"name\":\"2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA)\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICAICTA.2018.8541286\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICAICTA.2018.8541286","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

智能代理特别适合在电子游戏中完成任务。Dota 2中的智能代理被证明比OpenAI开发的bot更擅长职业人类。其他机器人无法产生良好的性能水平,因为机器人通常是使用基于规则的方法开发的。这使得bot的表现和开发者对游戏的理解一样好。在这种情况下使用的一种学习方法是对手建模;一种基于对手行为建模的尝试。首先,bot将进行一轮训练赛来收集环境数据。以对手当前的动作目标为目标回归,收集数据建立模型。从模型中得到的预测用于bot的考虑,以决定哪种行动对对手的行动是最好的。为了验证,实现了带有对手建模的bot和没有对手建模的bot,以及Dota 2中的默认bot。结果表明,对手建模作为一个组件能够提高实现的机器人的性能水平。这表明对手建模能够为机器人决定最佳行动提供相关信息。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Implementation of Intelligent Agent in Defense of the Ancient 2 through Utilization of Opponent Modeling
Intelligent agent is specially suited for completing tasks in video games. Intelligent agent in Dota 2 had been proven to be better at professional human with bot that was developed by OpenAI. Other bots haven’t been able to produce good level of performance as generally bots are developed with rule-based approach. This caused the bot to perform as good as the developer’s understanding of the game. One of learning method to be used in this case is opponent modeling; an attempt at modeling opponent based on its behavior. First, bot will play a round of training match to gather environment data. Model is built based on the data that is gathered with opponent’s current action target as the target regression. Prediction from the model is used in bot for consideration in deciding which action is best against opponent’s action. For validation, implemented bot with opponent modeling faced against bot without opponent modeling and also default bot from Dota 2. The results showed that opponent modeling as a component is able to increase the level of performance on the implemented bot. This showed that opponent modeling is able to provide relevant information for the bot to decide the best action.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信