{"title":"基于马尔可夫决策过程的人工智能与四人纸牌游戏 Big2 的出牌策略和自由出牌权探索","authors":"Lien-Wu Chen;Yiou-Rwong Lu","doi":"10.1109/TG.2024.3424431","DOIUrl":null,"url":null,"abstract":"The popular East Asian card game <italic>Big2</i> involves rules that do not allow players to view each other's hand cards, making artificial intelligence face challenges in performing well in this game. Based on Markov decision processes (MDPs) that can handle partially observable and stochastic information, we design the Big2MDP framework to explore card-playing strategies that minimize losing risks while maximizing scoring opportunities for the <italic>Big2</i> game. According to our review of relevant research, this is the first <italic>Big2</i> artificial intelligence framework with the following features: first, the ability to simultaneously consider scoring and losing points to make the best winning decisions with minimal losing risk, second, the capability to predict multiple opponents' actions to optimize the decision-making, and third, the adaptability to compete for the free-playing right to change card combinations at the essential moment. We implement a system of four-player card game <italic>Big2</i> on the Android platform to validate the feasibility and effectiveness of Big2MDP. Experimental results show that Big2MDP outperforms existing artificial intelligence methods, achieving the highest win rate and the least number of losing points as competing against both computer and human players in <italic>Big2</i> games.","PeriodicalId":55977,"journal":{"name":"IEEE Transactions on Games","volume":"17 2","pages":"267-281"},"PeriodicalIF":2.8000,"publicationDate":"2024-07-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Markov Decision Process-Based Artificial Intelligence With Card-Playing Strategy and Free-Playing Right Exploration for Four-Player Card Game Big2\",\"authors\":\"Lien-Wu Chen;Yiou-Rwong Lu\",\"doi\":\"10.1109/TG.2024.3424431\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The popular East Asian card game <italic>Big2</i> involves rules that do not allow players to view each other's hand cards, making artificial intelligence face challenges in performing well in this game. Based on Markov decision processes (MDPs) that can handle partially observable and stochastic information, we design the Big2MDP framework to explore card-playing strategies that minimize losing risks while maximizing scoring opportunities for the <italic>Big2</i> game. According to our review of relevant research, this is the first <italic>Big2</i> artificial intelligence framework with the following features: first, the ability to simultaneously consider scoring and losing points to make the best winning decisions with minimal losing risk, second, the capability to predict multiple opponents' actions to optimize the decision-making, and third, the adaptability to compete for the free-playing right to change card combinations at the essential moment. We implement a system of four-player card game <italic>Big2</i> on the Android platform to validate the feasibility and effectiveness of Big2MDP. Experimental results show that Big2MDP outperforms existing artificial intelligence methods, achieving the highest win rate and the least number of losing points as competing against both computer and human players in <italic>Big2</i> games.\",\"PeriodicalId\":55977,\"journal\":{\"name\":\"IEEE Transactions on Games\",\"volume\":\"17 2\",\"pages\":\"267-281\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2024-07-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Games\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10589271/\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Games","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10589271/","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Markov Decision Process-Based Artificial Intelligence With Card-Playing Strategy and Free-Playing Right Exploration for Four-Player Card Game Big2
The popular East Asian card game Big2 involves rules that do not allow players to view each other's hand cards, making artificial intelligence face challenges in performing well in this game. Based on Markov decision processes (MDPs) that can handle partially observable and stochastic information, we design the Big2MDP framework to explore card-playing strategies that minimize losing risks while maximizing scoring opportunities for the Big2 game. According to our review of relevant research, this is the first Big2 artificial intelligence framework with the following features: first, the ability to simultaneously consider scoring and losing points to make the best winning decisions with minimal losing risk, second, the capability to predict multiple opponents' actions to optimize the decision-making, and third, the adaptability to compete for the free-playing right to change card combinations at the essential moment. We implement a system of four-player card game Big2 on the Android platform to validate the feasibility and effectiveness of Big2MDP. Experimental results show that Big2MDP outperforms existing artificial intelligence methods, achieving the highest win rate and the least number of losing points as competing against both computer and human players in Big2 games.