Aggregating dependent signals with heavy-tailed combination tests.

Abstract

Combining dependent [Formula: see text]-values poses a long-standing challenge in statistical inference, particularly when aggregating findings from multiple methods to enhance signal detection. Recently, [Formula: see text]-value combination tests based on regularly-varying-tailed distributions, such as the Cauchy combination test and harmonic mean [Formula: see text]-value, have attracted attention for their robustness to unknown dependence. This paper provides a theoretical and empirical evaluation of these methods under an asymptotic regime where the number of [Formula: see text]-values is fixed and the global test significance level approaches zero. We examine two types of dependence among the [Formula: see text]-values. First, when [Formula: see text]-values are pairwise asymptotically independent, such as with bivariate normal test statistics with no perfect correlation, we prove that these combination tests are asymptotically valid. However, they become equivalent to the Bonferroni test as the significance level tends to zero for both one-sided and two-sided [Formula: see text]-values. Empirical investigations suggest that this equivalence can emerge at moderately small significance levels. Second, under pairwise quasi-asymptotic dependence, such as with bivariate [Formula: see text]-distributed test statistics, our simulations suggest that these combination tests can remain valid and exhibit notable power gains over the Bonferroni test, even as the significance level diminishes. These findings highlight the potential advantages of these combination tests in scenarios where [Formula: see text]-values exhibit substantial dependence. Our simulations also examine how test performance depends on the support and tail heaviness of the underlying distributions.