基于多边缘耦合的Blotto博弈算法求解

Vianney Perchet, P. Rigollet, Thibaut Le Gouic
{"title":"基于多边缘耦合的Blotto博弈算法求解","authors":"Vianney Perchet, P. Rigollet, Thibaut Le Gouic","doi":"10.1145/3490486.3538240","DOIUrl":null,"url":null,"abstract":"A century ago, Emile Borel published his seminal paper on the theory of play and integral equations with skew-symmetric kernels[1]. Borel describes what is now called the Blotto game: a resource-allocation game in which two players compete for over n different battlefields by simultaneously allocating resources to each battlefield. The following two additional characteristics are perhaps the most salient features of the Blotto game: Winner-takes-all: For each battlefield, the player allocating the most resources to a given battlefield wins the battlefield. Fixed budget: each player is subject to a fixed---and deterministic---budget that mixed strategies should satisfy almost surely. Despite its century-long existence, Nash equilibria for the Blotto game are only known under various restrictions on the main parameters of the problem: the budget of each player and the value given to each battlefield. Moreover, previous solutions for two-player games have consisted in constructing explicit solutions. Because of the budget constraints, these strategies can be decomposed into two parts: marginal distributions that indicate which (random) strategy to play on each battlefield and a coupling that correlates the marginal strategies in such a way to ensure that the budget constraint is satisfied almost surely. The first part may be studied independently of the second by considering what is known as the (General) Lotto game. In this game, the budget constraint needs only be enforced in expectation with respect to the randomization of the mixed strategies. While this setup lacks a defining characteristic of the Blotto game (fixed budget), it has the advantage of lending itself to more amenable computations. Indeed, unlike the Blotto game, a complete solution to the Lotto game was recently proposed in [2] where the authors describe an explicit Nash equilibrium in the most general case: asymmetric budget, asymmetric and heterogeneous values. In light of this progress, a natural question is whether the marginal solutions discovered in [2] could be coupled in such a way that the budget constraint is satisfied almost surely. We provide a positive answer to this question by appealing to an existing result from the theory of joint mixability [5]. Mixability asks the following question: Can n random variables X1, ..., Xn with prescribed marginal distributions Xi ~ Pi, be coupled in such a way that var(X1+ ··· + Xn)=0. Joint mixability is precisely the step required to go from a Lotto solution to a Blotto one by coupling the marginals of the Lotto solution in such a way that the budget constraint is satisfied. In this paper, we exploit a simple connection between joint mixability and the theory of multi-marginal couplings. We propose an algorithmic solution to the Blotto problem by efficiently constructing a coupling that satisfies the budget constraint almost surely and can be easily sampled from. Our construction relies on three key steps: first, we reduce the problem to a small number of marginals to bypass the inherent NP-hardness of multi-marginal problems, second, we discretize the marginals and finally, we employ a multi-marginal version of the Sinkhorn algorithm [3,4] to construct a coupling of the discretized marginals. This procedure outputs a coupling with continuous marginals that are close to the ones prescribed by the Lotto solutions of [2] and from which it is straightforward to sample. Furthermore, we quantify the combined effect of discretization error and of the Sinkhorn algorithm on the value of the game, effectively leading to an approximate Nash equilibrium and even to an approximately optimal solution in the case of symmetric values. For symmetric battlefield values and asymmetric budget, the Blotto game is constant-sum so optimal solutions exist, and our algorithm samples from an ε-optimal solution in time Õ(n2 + ε-4), independently of budgets and battlefield values. In the case of asymmetric values where optimal solutions need not exist but Nash equilibria do, our algorithm samples from an ε-Nash equilibrium with similar complexity but where implicit constants depend on various parameters of the game such as battlefield values. The full paper is available at: https://arxiv.org/abs/2202.07318.","PeriodicalId":209859,"journal":{"name":"Proceedings of the 23rd ACM Conference on Economics and Computation","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"An Algorithmic Solution to the Blotto Game using Multi-marginal Couplings\",\"authors\":\"Vianney Perchet, P. Rigollet, Thibaut Le Gouic\",\"doi\":\"10.1145/3490486.3538240\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A century ago, Emile Borel published his seminal paper on the theory of play and integral equations with skew-symmetric kernels[1]. Borel describes what is now called the Blotto game: a resource-allocation game in which two players compete for over n different battlefields by simultaneously allocating resources to each battlefield. The following two additional characteristics are perhaps the most salient features of the Blotto game: Winner-takes-all: For each battlefield, the player allocating the most resources to a given battlefield wins the battlefield. Fixed budget: each player is subject to a fixed---and deterministic---budget that mixed strategies should satisfy almost surely. Despite its century-long existence, Nash equilibria for the Blotto game are only known under various restrictions on the main parameters of the problem: the budget of each player and the value given to each battlefield. Moreover, previous solutions for two-player games have consisted in constructing explicit solutions. Because of the budget constraints, these strategies can be decomposed into two parts: marginal distributions that indicate which (random) strategy to play on each battlefield and a coupling that correlates the marginal strategies in such a way to ensure that the budget constraint is satisfied almost surely. The first part may be studied independently of the second by considering what is known as the (General) Lotto game. In this game, the budget constraint needs only be enforced in expectation with respect to the randomization of the mixed strategies. While this setup lacks a defining characteristic of the Blotto game (fixed budget), it has the advantage of lending itself to more amenable computations. Indeed, unlike the Blotto game, a complete solution to the Lotto game was recently proposed in [2] where the authors describe an explicit Nash equilibrium in the most general case: asymmetric budget, asymmetric and heterogeneous values. In light of this progress, a natural question is whether the marginal solutions discovered in [2] could be coupled in such a way that the budget constraint is satisfied almost surely. We provide a positive answer to this question by appealing to an existing result from the theory of joint mixability [5]. Mixability asks the following question: Can n random variables X1, ..., Xn with prescribed marginal distributions Xi ~ Pi, be coupled in such a way that var(X1+ ··· + Xn)=0. Joint mixability is precisely the step required to go from a Lotto solution to a Blotto one by coupling the marginals of the Lotto solution in such a way that the budget constraint is satisfied. In this paper, we exploit a simple connection between joint mixability and the theory of multi-marginal couplings. We propose an algorithmic solution to the Blotto problem by efficiently constructing a coupling that satisfies the budget constraint almost surely and can be easily sampled from. Our construction relies on three key steps: first, we reduce the problem to a small number of marginals to bypass the inherent NP-hardness of multi-marginal problems, second, we discretize the marginals and finally, we employ a multi-marginal version of the Sinkhorn algorithm [3,4] to construct a coupling of the discretized marginals. This procedure outputs a coupling with continuous marginals that are close to the ones prescribed by the Lotto solutions of [2] and from which it is straightforward to sample. Furthermore, we quantify the combined effect of discretization error and of the Sinkhorn algorithm on the value of the game, effectively leading to an approximate Nash equilibrium and even to an approximately optimal solution in the case of symmetric values. For symmetric battlefield values and asymmetric budget, the Blotto game is constant-sum so optimal solutions exist, and our algorithm samples from an ε-optimal solution in time Õ(n2 + ε-4), independently of budgets and battlefield values. In the case of asymmetric values where optimal solutions need not exist but Nash equilibria do, our algorithm samples from an ε-Nash equilibrium with similar complexity but where implicit constants depend on various parameters of the game such as battlefield values. The full paper is available at: https://arxiv.org/abs/2202.07318.\",\"PeriodicalId\":209859,\"journal\":{\"name\":\"Proceedings of the 23rd ACM Conference on Economics and Computation\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-02-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 23rd ACM Conference on Economics and Computation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3490486.3538240\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 23rd ACM Conference on Economics and Computation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3490486.3538240","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

一个世纪前,埃米尔·博雷尔(Emile Borel)发表了他关于游戏理论和带有偏对称核b[1]的积分方程的开创性论文。Borel描述了现在所谓的Blotto游戏:一种资源分配游戏,两名玩家通过同时向每个战场分配资源来争夺超过n个不同的战场。以下两个额外特征可能是《Blotto》游戏最显著的特征:赢家通吃:对于每个战场,在给定战场上分配最多资源的玩家将赢得战场。固定预算:每个玩家都受制于一个固定的(且确定的)预算,混合策略几乎肯定能满足这个预算。尽管已经存在了一个世纪,但只有在对问题主要参数的各种限制下,才能知道Blotto游戏的纳什均衡:每个玩家的预算和每个战场的价值。此外,之前的双人博弈解决方案都是构建明确的解决方案。由于预算约束,这些策略可以分解为两部分:表明在每个战场上使用哪种(随机)策略的边际分布,以及以确保几乎肯定地满足预算约束的方式将边际策略关联起来的耦合。第一部分可以通过考虑所谓的(一般)乐透游戏而独立于第二部分进行研究。在这个博弈中,预算约束只需要根据混合策略的随机化来强制执行。虽然这种设置缺乏Blotto游戏的定义特征(固定预算),但它的优势在于可以进行更易于接受的计算。事实上,与Lotto游戏不同,Lotto游戏的完整解决方案最近在b[2]中提出,作者描述了最一般情况下的显式纳什均衡:不对称预算,不对称和异构值。鉴于这一进展,一个自然的问题是,b[2]中发现的边际解能否以一种几乎肯定能满足预算约束的方式结合在一起。我们利用节理可混性理论的现有结果,对这个问题给出了一个肯定的答案。可混性提出了以下问题:n个随机变量X1,…联合可混合性正是通过以满足预算约束的方式耦合Lotto解的边际来从Lotto解到Blotto解所需的步骤。在本文中,我们建立了接头可混性与多边缘耦合理论之间的简单联系。我们提出了一种解决Blotto问题的算法,通过有效地构造一个几乎肯定满足预算约束的耦合,并且可以很容易地从中采样。我们的构造依赖于三个关键步骤:首先,我们将问题简化为少量的边缘,以绕过多边缘问题固有的np -硬度;其次,我们将边缘离散化;最后,我们使用Sinkhorn算法的多边缘版本[3,4]来构造离散化边缘的耦合。这个过程输出一个具有连续边际的耦合,它接近于[2]的Lotto解所规定的边际,并且从中可以直接采样。此外,我们量化了离散误差和Sinkhorn算法对博弈值的综合影响,有效地导致了近似纳什均衡,甚至在对称值的情况下得到了近似最优解。对于对称战场值和非对称预算,Blotto博弈是常和的,因此存在最优解,并且我们的算法在时间Õ(n2 + ε-4)上从ε-最优解中采样,独立于预算和战场值。在不对称值的情况下,最优解不需要存在,但纳什均衡存在,我们的算法从具有相似复杂性的ε-纳什均衡中采样,但隐式常数依赖于博弈的各种参数,如战场值。全文可在https://arxiv.org/abs/2202.07318上找到。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An Algorithmic Solution to the Blotto Game using Multi-marginal Couplings
A century ago, Emile Borel published his seminal paper on the theory of play and integral equations with skew-symmetric kernels[1]. Borel describes what is now called the Blotto game: a resource-allocation game in which two players compete for over n different battlefields by simultaneously allocating resources to each battlefield. The following two additional characteristics are perhaps the most salient features of the Blotto game: Winner-takes-all: For each battlefield, the player allocating the most resources to a given battlefield wins the battlefield. Fixed budget: each player is subject to a fixed---and deterministic---budget that mixed strategies should satisfy almost surely. Despite its century-long existence, Nash equilibria for the Blotto game are only known under various restrictions on the main parameters of the problem: the budget of each player and the value given to each battlefield. Moreover, previous solutions for two-player games have consisted in constructing explicit solutions. Because of the budget constraints, these strategies can be decomposed into two parts: marginal distributions that indicate which (random) strategy to play on each battlefield and a coupling that correlates the marginal strategies in such a way to ensure that the budget constraint is satisfied almost surely. The first part may be studied independently of the second by considering what is known as the (General) Lotto game. In this game, the budget constraint needs only be enforced in expectation with respect to the randomization of the mixed strategies. While this setup lacks a defining characteristic of the Blotto game (fixed budget), it has the advantage of lending itself to more amenable computations. Indeed, unlike the Blotto game, a complete solution to the Lotto game was recently proposed in [2] where the authors describe an explicit Nash equilibrium in the most general case: asymmetric budget, asymmetric and heterogeneous values. In light of this progress, a natural question is whether the marginal solutions discovered in [2] could be coupled in such a way that the budget constraint is satisfied almost surely. We provide a positive answer to this question by appealing to an existing result from the theory of joint mixability [5]. Mixability asks the following question: Can n random variables X1, ..., Xn with prescribed marginal distributions Xi ~ Pi, be coupled in such a way that var(X1+ ··· + Xn)=0. Joint mixability is precisely the step required to go from a Lotto solution to a Blotto one by coupling the marginals of the Lotto solution in such a way that the budget constraint is satisfied. In this paper, we exploit a simple connection between joint mixability and the theory of multi-marginal couplings. We propose an algorithmic solution to the Blotto problem by efficiently constructing a coupling that satisfies the budget constraint almost surely and can be easily sampled from. Our construction relies on three key steps: first, we reduce the problem to a small number of marginals to bypass the inherent NP-hardness of multi-marginal problems, second, we discretize the marginals and finally, we employ a multi-marginal version of the Sinkhorn algorithm [3,4] to construct a coupling of the discretized marginals. This procedure outputs a coupling with continuous marginals that are close to the ones prescribed by the Lotto solutions of [2] and from which it is straightforward to sample. Furthermore, we quantify the combined effect of discretization error and of the Sinkhorn algorithm on the value of the game, effectively leading to an approximate Nash equilibrium and even to an approximately optimal solution in the case of symmetric values. For symmetric battlefield values and asymmetric budget, the Blotto game is constant-sum so optimal solutions exist, and our algorithm samples from an ε-optimal solution in time Õ(n2 + ε-4), independently of budgets and battlefield values. In the case of asymmetric values where optimal solutions need not exist but Nash equilibria do, our algorithm samples from an ε-Nash equilibrium with similar complexity but where implicit constants depend on various parameters of the game such as battlefield values. The full paper is available at: https://arxiv.org/abs/2202.07318.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信