{"title":"现代数据的广义独立性检验","authors":"Mingshuo Liu, Doudou Zhou, Hao Chen","doi":"arxiv-2409.07745","DOIUrl":null,"url":null,"abstract":"The test of independence is a crucial component of modern data analysis.\nHowever, traditional methods often struggle with the complex dependency\nstructures found in high-dimensional data. To overcome this challenge, we\nintroduce a novel test statistic that captures intricate relationships using\nsimilarity and dissimilarity information derived from the data. The statistic\nexhibits strong power across a broad range of alternatives for high-dimensional\ndata, as demonstrated in extensive simulation studies. Under mild conditions,\nwe show that the new test statistic converges to the $\\chi^2_4$ distribution\nunder the permutation null distribution, ensuring straightforward type I error\ncontrol. Furthermore, our research advances the moment method in proving the\njoint asymptotic normality of multiple double-indexed permutation statistics.\nWe showcase the practical utility of this new test with an application to the\nGenotype-Tissue Expression dataset, where it effectively measures associations\nbetween human tissues.","PeriodicalId":501379,"journal":{"name":"arXiv - STAT - Statistics Theory","volume":"33 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Generalized Independence Test for Modern Data\",\"authors\":\"Mingshuo Liu, Doudou Zhou, Hao Chen\",\"doi\":\"arxiv-2409.07745\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The test of independence is a crucial component of modern data analysis.\\nHowever, traditional methods often struggle with the complex dependency\\nstructures found in high-dimensional data. To overcome this challenge, we\\nintroduce a novel test statistic that captures intricate relationships using\\nsimilarity and dissimilarity information derived from the data. The statistic\\nexhibits strong power across a broad range of alternatives for high-dimensional\\ndata, as demonstrated in extensive simulation studies. Under mild conditions,\\nwe show that the new test statistic converges to the $\\\\chi^2_4$ distribution\\nunder the permutation null distribution, ensuring straightforward type I error\\ncontrol. Furthermore, our research advances the moment method in proving the\\njoint asymptotic normality of multiple double-indexed permutation statistics.\\nWe showcase the practical utility of this new test with an application to the\\nGenotype-Tissue Expression dataset, where it effectively measures associations\\nbetween human tissues.\",\"PeriodicalId\":501379,\"journal\":{\"name\":\"arXiv - STAT - Statistics Theory\",\"volume\":\"33 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - STAT - Statistics Theory\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.07745\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - STAT - Statistics Theory","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.07745","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
独立性检验是现代数据分析的重要组成部分。然而,传统方法往往难以应对高维数据中复杂的依赖性结构。为了克服这一难题,我们引入了一种新型检验统计量,利用从数据中获得的相似性和不相似性信息来捕捉错综复杂的关系。大量的模拟研究表明,该统计量在高维数据的各种替代方案中都表现出强大的威力。在温和的条件下,我们证明新的检验统计量收敛于 permutation null 分布下的 $\chi^2_4$ 分布,确保了直接的 I 型误差控制。此外,我们的研究还推进了矩方法的发展,证明了多个双指数置换统计量的联合渐近正态性。我们在基因型-组织表达数据集(Genotype-Tissue Expression dataset)上的应用展示了这一新检验的实用性,它能有效地测量人体组织之间的关联。
The test of independence is a crucial component of modern data analysis.
However, traditional methods often struggle with the complex dependency
structures found in high-dimensional data. To overcome this challenge, we
introduce a novel test statistic that captures intricate relationships using
similarity and dissimilarity information derived from the data. The statistic
exhibits strong power across a broad range of alternatives for high-dimensional
data, as demonstrated in extensive simulation studies. Under mild conditions,
we show that the new test statistic converges to the $\chi^2_4$ distribution
under the permutation null distribution, ensuring straightforward type I error
control. Furthermore, our research advances the moment method in proving the
joint asymptotic normality of multiple double-indexed permutation statistics.
We showcase the practical utility of this new test with an application to the
Genotype-Tissue Expression dataset, where it effectively measures associations
between human tissues.