Annales de l'I.H.P. Probabilites et statistiques最新文献

筛选

英文中文

Performance Guarantees for Policy Learning. 政策学习的绩效保障。

Annales de l'I.H.P. Probabilites et statistiques Pub Date : 2020-08-01 Epub Date: 2020-06-26 DOI: 10.1214/19-aihp1034

Alex Luedtke, Antoine Chambaz

{"title":"Performance Guarantees for Policy Learning.","authors":"Alex Luedtke, Antoine Chambaz","doi":"10.1214/19-aihp1034","DOIUrl":"10.1214/19-aihp1034","url":null,"abstract":"<p><p>This article gives performance guarantees for the regret decay in optimal policy estimation. We give a margin-free result showing that the regret decay for estimating a within-class optimal policy is second-order for empirical risk minimizers over Donsker classes when the data are generated from a fixed data distribution that does not change with sample size, with regret decaying at a faster rate than the standard error of an efficient estimator of the value of an optimal policy. We also present a result giving guarantees on the regret decay of policy estimators for the case that the policy falls within a restricted class and the data are generated from local perturbations of a fixed distribution, where this guarantee is uniform in the direction of the local perturbation. Finally, we give a result from the classification literature that shows that faster regret decay is possible via plug-in estimation provided a margin condition holds. Three examples are considered. In these examples, the regret is expressed in terms of either the mean value or the median value, and the number of possible actions is either two or finitely many.</p>","PeriodicalId":93635,"journal":{"name":"Annales de l'I.H.P. Probabilites et statistiques","volume":"56 3","pages":"2162-2188"},"PeriodicalIF":0.0,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8939837/pdf/nihms-1620989.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40316576","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0