具有确定奇偶性和多重可达性目标的马尔可夫决策过程

Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler
{"title":"具有确定奇偶性和多重可达性目标的马尔可夫决策过程","authors":"Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler","doi":"arxiv-2408.01212","DOIUrl":null,"url":null,"abstract":"This paper considers the problem of finding strategies that satisfy a mixture\nof sure and threshold objectives in Markov decision processes. We focus on a\nsingle $\\omega$-regular objective expressed as parity that must be surely met\nwhile satisfying $n$ reachability objectives towards sink states with some\nprobability thresholds too. We consider three variants of the problem: (a)\nstrict and (b) non-strict thresholds on all reachability objectives, and (c)\nmaximizing the thresholds with respect to a lexicographic order. We show that\n(a) and (c) can be reduced to solving parity games, and (b) can be solved in\n$\\sf{EXPTIME}$. Strategy complexities as well as algorithms are provided for\nall cases.","PeriodicalId":501316,"journal":{"name":"arXiv - CS - Computer Science and Game Theory","volume":"86 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Markov Decision Processes with Sure Parity and Multiple Reachability Objectives\",\"authors\":\"Raphaël Berthon, Joost-Pieter Katoen, Tobias Winkler\",\"doi\":\"arxiv-2408.01212\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper considers the problem of finding strategies that satisfy a mixture\\nof sure and threshold objectives in Markov decision processes. We focus on a\\nsingle $\\\\omega$-regular objective expressed as parity that must be surely met\\nwhile satisfying $n$ reachability objectives towards sink states with some\\nprobability thresholds too. We consider three variants of the problem: (a)\\nstrict and (b) non-strict thresholds on all reachability objectives, and (c)\\nmaximizing the thresholds with respect to a lexicographic order. We show that\\n(a) and (c) can be reduced to solving parity games, and (b) can be solved in\\n$\\\\sf{EXPTIME}$. Strategy complexities as well as algorithms are provided for\\nall cases.\",\"PeriodicalId\":501316,\"journal\":{\"name\":\"arXiv - CS - Computer Science and Game Theory\",\"volume\":\"86 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-08-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Computer Science and Game Theory\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2408.01212\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Computer Science and Game Theory","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.01212","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

本文探讨了在马尔可夫决策过程中寻找满足确定目标和阈值目标混合的策略的问题。我们关注的是以奇偶性表示的单一 $\omega$ 规则目标,该目标必须在满足 $n$ 可到达性目标的同时,还必须满足一些概率阈值。我们考虑了该问题的三种变体:(a) 所有可达性目标上的严格阈值和 (b) 非严格阈值,以及 (c) 最大化相对于词典顺序的阈值。我们证明(a)和(c)可以简化为求解奇偶性博弈,而(b)可以在$\sf{EXPTIME}$内求解。我们提供了所有情况的策略复杂性和算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Markov Decision Processes with Sure Parity and Multiple Reachability Objectives
This paper considers the problem of finding strategies that satisfy a mixture of sure and threshold objectives in Markov decision processes. We focus on a single $\omega$-regular objective expressed as parity that must be surely met while satisfying $n$ reachability objectives towards sink states with some probability thresholds too. We consider three variants of the problem: (a) strict and (b) non-strict thresholds on all reachability objectives, and (c) maximizing the thresholds with respect to a lexicographic order. We show that (a) and (c) can be reduced to solving parity games, and (b) can be solved in $\sf{EXPTIME}$. Strategy complexities as well as algorithms are provided for all cases.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信