{"title":"BaziGooshi:游戏泛化的强化学习混合模型","authors":"Sara Karimi;Sahar Asadi;Amir H. Payberah","doi":"10.1109/TG.2024.3355172","DOIUrl":null,"url":null,"abstract":"While reinforcement learning (RL) is gaining popularity in gameplay, creating a generalized RL model is still challenging. This study presents \n<sc>BaziGooshi</small>\n, a generalized RL solution for games, focusing on two different types of games: 1) a puzzle game \n<italic>Candy Crush Friends Saga</i>\n and 2) a platform game \n<italic>Sonic the Hedgehog Genesis</i>\n. \n<sc>BaziGooshi</small>\n rewards RL agents for mastering a set of intrinsic basic skills as well as achieving the game objectives. The solution includes a hybrid model that takes advantage of a combination of several agents pretrained using intrinsic or extrinsic rewards to determine the actions. We propose an RL-based method for assigning weights to the pretrained agents. Through experiments, we show that the RL-based approach improves generalization to unseen levels, and \n<sc>BaziGooshi</small>\n surpasses the performance of most of the defined baselines in both games. Also, we perform additional experiments to investigate further the impacts of using intrinsic rewards and the effects of using different combinations in the proposed hybrid models.","PeriodicalId":55977,"journal":{"name":"IEEE Transactions on Games","volume":"16 3","pages":"722-734"},"PeriodicalIF":1.7000,"publicationDate":"2024-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"BaziGooshi: A Hybrid Model of Reinforcement Learning for Generalization in Gameplay\",\"authors\":\"Sara Karimi;Sahar Asadi;Amir H. Payberah\",\"doi\":\"10.1109/TG.2024.3355172\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"While reinforcement learning (RL) is gaining popularity in gameplay, creating a generalized RL model is still challenging. This study presents \\n<sc>BaziGooshi</small>\\n, a generalized RL solution for games, focusing on two different types of games: 1) a puzzle game \\n<italic>Candy Crush Friends Saga</i>\\n and 2) a platform game \\n<italic>Sonic the Hedgehog Genesis</i>\\n. \\n<sc>BaziGooshi</small>\\n rewards RL agents for mastering a set of intrinsic basic skills as well as achieving the game objectives. The solution includes a hybrid model that takes advantage of a combination of several agents pretrained using intrinsic or extrinsic rewards to determine the actions. We propose an RL-based method for assigning weights to the pretrained agents. Through experiments, we show that the RL-based approach improves generalization to unseen levels, and \\n<sc>BaziGooshi</small>\\n surpasses the performance of most of the defined baselines in both games. Also, we perform additional experiments to investigate further the impacts of using intrinsic rewards and the effects of using different combinations in the proposed hybrid models.\",\"PeriodicalId\":55977,\"journal\":{\"name\":\"IEEE Transactions on Games\",\"volume\":\"16 3\",\"pages\":\"722-734\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2024-01-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Games\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10417835/\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Games","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10417835/","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
BaziGooshi: A Hybrid Model of Reinforcement Learning for Generalization in Gameplay
While reinforcement learning (RL) is gaining popularity in gameplay, creating a generalized RL model is still challenging. This study presents
BaziGooshi
, a generalized RL solution for games, focusing on two different types of games: 1) a puzzle game
Candy Crush Friends Saga
and 2) a platform game
Sonic the Hedgehog Genesis
.
BaziGooshi
rewards RL agents for mastering a set of intrinsic basic skills as well as achieving the game objectives. The solution includes a hybrid model that takes advantage of a combination of several agents pretrained using intrinsic or extrinsic rewards to determine the actions. We propose an RL-based method for assigning weights to the pretrained agents. Through experiments, we show that the RL-based approach improves generalization to unseen levels, and
BaziGooshi
surpasses the performance of most of the defined baselines in both games. Also, we perform additional experiments to investigate further the impacts of using intrinsic rewards and the effects of using different combinations in the proposed hybrid models.