Australian & New Zealand Journal of Statistics最新文献_第4页

Robust PCA for high-dimensional data based on characteristic transformation 基于特征变换的高维数据鲁棒主成分分析

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2023-06-13 DOI: 10.1111/anzs.12385

Lingyu He, Yanrong Yang, Bo Zhang

{"title":"Robust PCA for high-dimensional data based on characteristic transformation","authors":"Lingyu He, Yanrong Yang, Bo Zhang","doi":"10.1111/anzs.12385","DOIUrl":"https://doi.org/10.1111/anzs.12385","url":null,"abstract":"<div>\u0000 \u0000 <p>In this paper, we propose a novel robust principal component analysis (PCA) for high-dimensional data in the presence of various heterogeneities, in particular strong tailing and outliers. A transformation motivated by the characteristic function is constructed to improve the robustness of the classical PCA. The suggested method has the distinct advantage of dealing with heavy-tail-distributed data, whose covariances may be non-existent (positively infinite, for instance), in addition to the usual outliers. The proposed approach is also a case of kernel principal component analysis (KPCA) and employs the robust and non-linear properties via a bounded and non-linear kernel function. The merits of the new method are illustrated by some statistical properties, including the upper bound of the excess error and the behaviour of the large eigenvalues under a spiked covariance model. Additionally, using a variety of simulations, we demonstrate the benefits of our approach over the classical PCA. Finally, using data on protein expression in mice of various genotypes in a biological study, we apply the novel robust PCA to categorise the mice and find that our approach is more effective at identifying abnormal mice than the classical PCA.</p>\u0000 </div>","PeriodicalId":55428,"journal":{"name":"Australian & New Zealand Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50150434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Bayesian neural tree models for nonparametric regression 非参数回归的贝叶斯神经树模型

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2023-06-12 DOI: 10.1111/anzs.12386

Tanujit Chakraborty, Gauri Kamat, Ashis Kumar Chakraborty

{"title":"Bayesian neural tree models for nonparametric regression","authors":"Tanujit Chakraborty, Gauri Kamat, Ashis Kumar Chakraborty","doi":"10.1111/anzs.12386","DOIUrl":"https://doi.org/10.1111/anzs.12386","url":null,"abstract":"<div>\u0000 \u0000 <p>Frequentist and Bayesian methods differ in many aspects but share some basic optimal properties. In real-life prediction problems, situations exist in which a model based on one of the above paradigms is preferable depending on some subjective criteria. Nonparametric classification and regression techniques, such as decision trees and neural networks, have both frequentist (classification and regression trees (CARTs) and artificial neural networks) as well as Bayesian counterparts (Bayesian CART and Bayesian neural networks) to learning from data. In this paper, we present two hybrid models combining the Bayesian and frequentist versions of CART and neural networks, which we call the Bayesian neural tree (BNT) models. BNT models can simultaneously perform feature selection and prediction, are highly flexible, and generalise well in settings with limited training observations. We study the statistical consistency of the proposed approaches and derive the optimal value of a vital model parameter. The excellent performance of the newly proposed BNT models is shown using simulation studies. We also provide some illustrative examples using a wide variety of standard regression datasets from a public available machine learning repository to show the superiority of the proposed models in comparison to popularly used Bayesian CART and Bayesian neural network models.</p>\u0000 </div>","PeriodicalId":55428,"journal":{"name":"Australian & New Zealand Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50139340","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A nonparametric mixture approach to density and null proportion estimation in large-scale multiple comparison problems 大规模多重比较问题中密度和零比估计的非参数混合方法

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2023-04-04 DOI: 10.1111/anzs.12383

Xiangjie Xue, Yong Wang

引用次数: 0

A method to reduce the width of confidence intervals by using a normal scores transformation 一种利用正态分数变换减小置信区间宽度的方法

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2023-03-17 DOI: 10.1111/anzs.12384

T. W. O’Gorman

{"title":"A method to reduce the width of confidence intervals by using a normal scores transformation","authors":"T. W. O’Gorman","doi":"10.1111/anzs.12384","DOIUrl":"https://doi.org/10.1111/anzs.12384","url":null,"abstract":"<div>\u0000 \u0000 <p>In stating the results of their research, scientists usually want to publish narrow confidence intervals because they give precise estimates of the effects of interest. In many cases, the researcher would want to use the narrowest interval that maintains the desired coverage probability. In this manuscript, we propose a new method of finding confidence intervals that are often narrower than traditional confidence intervals for any individual parameter in a linear model if the errors are from a skewed distribution or from a long-tailed symmetric distribution. If the errors are normally distributed, we show that the width of the proposed normal scores confidence interval will not be much greater than the width of the traditional interval. If the dataset includes predictor variables that are uncorrelated or moderately correlated then the confidence intervals will maintain their coverage probability. However, if the covariates are highly correlated, then the coverage probability of the proposed confidence interval may be slightly lower than the nominal value. The procedure is not computationally intensive and an R program is available to determine the normal scores 95% confidence interval. Whenever the covariates are not highly correlated, the normal scores confidence interval is recommended for the analysis of datasets having 50 or more observations.</p>\u0000 </div>","PeriodicalId":55428,"journal":{"name":"Australian & New Zealand Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2023-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50136144","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Variable selection in heterogeneous panel data models with cross-sectional dependence 具有截面相关性的异质面板数据模型中的变量选择

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2023-02-15 DOI: 10.1111/anzs.12381

Xiaoling Mei, Bin Peng, Huanjun Zhu

引用次数: 0

On two conjectures about perturbations of the stochastic growth rate 关于随机增长率扰动的两个猜想

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2023-02-15 DOI: 10.1111/anzs.12382

Stefano Giaimo

引用次数: 0

A Richards growth model to predict fruit weight 预测水果重量的理查兹生长模型

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2023-01-05 DOI: 10.1111/anzs.12380

Daniel Gerhard, Elena Moltchanova

引用次数: 1

Minimum cost-compression risk in principal component analysis 主成分分析中的最小成本压缩风险

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2022-12-28 DOI: 10.1111/anzs.12378

Bhargab Chattopadhyay, Swarnali Banerjee

{"title":"Minimum cost-compression risk in principal component analysis","authors":"Bhargab Chattopadhyay, Swarnali Banerjee","doi":"10.1111/anzs.12378","DOIUrl":"10.1111/anzs.12378","url":null,"abstract":"<div>\u0000 \u0000 <p>Principal Component Analysis (PCA) is a popular multivariate analytic tool which can be used for dimension reduction without losing much information. Data vectors containing a large number of features arriving sequentially may be correlated with each other. An effective algorithm for such situations is online PCA. Existing Online PCA research works revolve around proposing efficient scalable updating algorithms focusing on compression loss only. They do not take into account the size of the dataset at which further arrival of data vectors can be terminated and dimension reduction can be applied. It is well known that the dataset size contributes to reducing the compression loss – the smaller the dataset size, the larger the compression loss while larger the dataset size, the lesser the compression loss. However, the reduction in compression loss by increasing dataset size will increase the total data collection cost. In this paper, we move beyond the scalability and updation problems related to Online PCA and focus on optimising a cost-compression loss which considers the compression loss and data collection cost. We minimise the corresponding risk using a two-stage PCA algorithm. The resulting two-stage algorithm is a fast and an efficient alternative to Online PCA and is shown to exhibit attractive convergence properties with no assumption on specific data distributions. Experimental studies demonstrate similar results and further illustrations are provided using real data. As an extension, a multi-stage PCA algorithm is discussed as well. Given the time complexity, the two-stage PCA algorithm is emphasised over the multi-stage PCA algorithm for online data.</p>\u0000 </div>","PeriodicalId":55428,"journal":{"name":"Australian & New Zealand Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82020722","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A new minification integer-valued autoregressive process driven by explanatory variables 一种新的由解释变量驱动的最小化整数值自回归过程

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2022-12-28 DOI: 10.1111/anzs.12379

Lianyong Qian, Fukang Zhu

引用次数: 2

Small area estimation under a semi-parametric covariate measured with error 半参数协变量测量误差下的小面积估计

IF 1.1 4区数学

Australian & New Zealand Journal of Statistics Pub Date : 2022-12-08 DOI: 10.1111/anzs.12377

Reyhane Sefidkar, Mahmoud Torabi, Amir Kavousi

{"title":"Small area estimation under a semi-parametric covariate measured with error","authors":"Reyhane Sefidkar, Mahmoud Torabi, Amir Kavousi","doi":"10.1111/anzs.12377","DOIUrl":"10.1111/anzs.12377","url":null,"abstract":"<div>\u0000 \u0000 <p>In recent years, small area estimation has played an important role in statistics as it deals with the problem of obtaining reliable estimates for parameters of interest in areas with small or even zero sample sizes corresponding to population sizes. Nested error linear regression models are often used in small area estimation assuming that the covariates are measured without error and also the relationship between covariates and response variable is linear. Small area models have also been extended to the case in which a linear relationship may not hold, using penalised spline (P-spline) regression, but assuming that the covariates are measured without error. Recently, a nested error regression model using a P-spline regression model, for the fixed part of the model, has been studied assuming the presence of measurement error in covariate, in the Bayesian framework. In this paper, we propose a frequentist approach to study a semi-parametric nested error regression model using P-splines with a covariate measured with error. In particular, the pseudo-empirical best predictors of small area means and their corresponding mean squared prediction error estimates are studied. Performance of the proposed approach is evaluated through a simulation and also by a real data application. We propose a frequentist approach to study a semi-parametric nested error regression model using P-splines with a covariate measured with error.</p>\u0000 </div>","PeriodicalId":55428,"journal":{"name":"Australian & New Zealand Journal of Statistics","volume":null,"pages":null},"PeriodicalIF":1.1,"publicationDate":"2022-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89503682","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0