{"title":"Maxway CRT: improving the robustness of the model-X inference","authors":"Shuangning Li, Molei Liu","doi":"10.1093/jrsssb/qkad081","DOIUrl":null,"url":null,"abstract":"Abstract The model-X conditional randomisation test (CRT) is a flexible and powerful testing procedure for testing the hypothesis X⫫Y∣Z. However, it requires perfect knowledge of X∣Z and may lose its validity when there is an error in modelling X∣Z. This problem is even more severe when Z is of high dimensionality. In response to this, we propose the Maxway CRT, which learns the distribution of Y∣Z and uses it to calibrate the resampling distribution of X to gain robustness to the error in modelling X. We prove that the type-I error inflation of the Maxway CRT can be controlled by the learning error for a low-dimensional adjusting model plus the product of learning errors for X∣Z and Y∣Z, interpreted as an ‘almost doubly robust’ property. Based on this, we develop implementing algorithms of the Maxway CRT in practical scenarios including (surrogate-assisted) semi-supervised learning (SA-SSL) and transfer learning (TL). Through simulations, we demonstrate that the Maxway CRT achieves significantly better type-I error control than existing model-X inference approaches while preserving similar powers. Finally, we apply our methodology to two real examples of SA-SSL and TL.","PeriodicalId":49982,"journal":{"name":"Journal of the Royal Statistical Society Series B-Statistical Methodology","volume":"4 1","pages":"0"},"PeriodicalIF":3.1000,"publicationDate":"2023-08-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of the Royal Statistical Society Series B-Statistical Methodology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jrsssb/qkad081","RegionNum":1,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract The model-X conditional randomisation test (CRT) is a flexible and powerful testing procedure for testing the hypothesis X⫫Y∣Z. However, it requires perfect knowledge of X∣Z and may lose its validity when there is an error in modelling X∣Z. This problem is even more severe when Z is of high dimensionality. In response to this, we propose the Maxway CRT, which learns the distribution of Y∣Z and uses it to calibrate the resampling distribution of X to gain robustness to the error in modelling X. We prove that the type-I error inflation of the Maxway CRT can be controlled by the learning error for a low-dimensional adjusting model plus the product of learning errors for X∣Z and Y∣Z, interpreted as an ‘almost doubly robust’ property. Based on this, we develop implementing algorithms of the Maxway CRT in practical scenarios including (surrogate-assisted) semi-supervised learning (SA-SSL) and transfer learning (TL). Through simulations, we demonstrate that the Maxway CRT achieves significantly better type-I error control than existing model-X inference approaches while preserving similar powers. Finally, we apply our methodology to two real examples of SA-SSL and TL.
期刊介绍:
Series B (Statistical Methodology) aims to publish high quality papers on the methodological aspects of statistics and data science more broadly. The objective of papers should be to contribute to the understanding of statistical methodology and/or to develop and improve statistical methods; any mathematical theory should be directed towards these aims. The kinds of contribution considered include descriptions of new methods of collecting or analysing data, with the underlying theory, an indication of the scope of application and preferably a real example. Also considered are comparisons, critical evaluations and new applications of existing methods, contributions to probability theory which have a clear practical bearing (including the formulation and analysis of stochastic models), statistical computation or simulation where original methodology is involved and original contributions to the foundations of statistical science. Reviews of methodological techniques are also considered. A paper, even if correct and well presented, is likely to be rejected if it only presents straightforward special cases of previously published work, if it is of mathematical interest only, if it is too long in relation to the importance of the new material that it contains or if it is dominated by computations or simulations of a routine nature.