{"title":"利用 DREAM 训练代理评估 Geister 中不完美信息的影响","authors":"Lucien Troillet;Kiminori Matsuzaki","doi":"10.1109/TG.2023.3324737","DOIUrl":null,"url":null,"abstract":"Imperfect information games (IIGs) are a popular subject in the field of artificial intelligence. In this study, we consider them and propose that they can be classified according to the impact and visualizability of the imperfect information. We use \n<italic>Geister</i>\n, a Board IIG, to create multiple variant games that we use as an abstraction for IIGs. We then train agents to play each variant using deep regret minimization with advantage baselines and model-free learning, a neural-network variation of counterfactual regret minimization. We observe the performance of our agents and use them to qualitatively assess the characteristics of our IIGs with regards to our proposed terminology.","PeriodicalId":55977,"journal":{"name":"IEEE Transactions on Games","volume":"16 3","pages":"598-610"},"PeriodicalIF":1.7000,"publicationDate":"2023-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Evaluating the Influence of Imperfect Information in Geister Using DREAM Trained Agents\",\"authors\":\"Lucien Troillet;Kiminori Matsuzaki\",\"doi\":\"10.1109/TG.2023.3324737\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Imperfect information games (IIGs) are a popular subject in the field of artificial intelligence. In this study, we consider them and propose that they can be classified according to the impact and visualizability of the imperfect information. We use \\n<italic>Geister</i>\\n, a Board IIG, to create multiple variant games that we use as an abstraction for IIGs. We then train agents to play each variant using deep regret minimization with advantage baselines and model-free learning, a neural-network variation of counterfactual regret minimization. We observe the performance of our agents and use them to qualitatively assess the characteristics of our IIGs with regards to our proposed terminology.\",\"PeriodicalId\":55977,\"journal\":{\"name\":\"IEEE Transactions on Games\",\"volume\":\"16 3\",\"pages\":\"598-610\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2023-10-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Games\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10286289/\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Games","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10286289/","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Evaluating the Influence of Imperfect Information in Geister Using DREAM Trained Agents
Imperfect information games (IIGs) are a popular subject in the field of artificial intelligence. In this study, we consider them and propose that they can be classified according to the impact and visualizability of the imperfect information. We use
Geister
, a Board IIG, to create multiple variant games that we use as an abstraction for IIGs. We then train agents to play each variant using deep regret minimization with advantage baselines and model-free learning, a neural-network variation of counterfactual regret minimization. We observe the performance of our agents and use them to qualitatively assess the characteristics of our IIGs with regards to our proposed terminology.