{"title":"Finite mixture of regression models for censored data based on the skew-t distribution","authors":"Jiwon Park, Dipak K. Dey, Víctor H. Lachos","doi":"10.1007/s00180-024-01459-4","DOIUrl":null,"url":null,"abstract":"<p>Finite mixture models have been widely used to model and analyze data from heterogeneous populations. In practical scenarios, these types of data often confront upper and/or lower detection limits due to the constraints imposed by experimental apparatuses. Additional complexity arises when measures of each mixture component significantly deviate from the normal distribution, manifesting characteristics such as multimodality, asymmetry, and heavy-tailed behavior, simultaneously. This paper introduces a flexible model tailored for censored data to address these intricacies, leveraging the finite mixture of skew-<i>t</i> distributions. An Expectation Conditional Maximization Either (ECME) algorithm, is developed to efficiently derive parameter estimates by iteratively maximizing the observed data log-likelihood function. The algorithm has closed-form expressions at the E-step that rely on formulas for the mean and variance of truncated skew-<i>t</i> distributions. Moreover, a method based on general information principles is presented for approximating the asymptotic covariance matrix of the estimators. Results obtained from the analysis of both simulated and real datasets demonstrate the proposed method’s effectiveness.</p>","PeriodicalId":55223,"journal":{"name":"Computational Statistics","volume":"38 1","pages":""},"PeriodicalIF":1.0000,"publicationDate":"2024-02-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computational Statistics","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1007/s00180-024-01459-4","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0
Abstract
Finite mixture models have been widely used to model and analyze data from heterogeneous populations. In practical scenarios, these types of data often confront upper and/or lower detection limits due to the constraints imposed by experimental apparatuses. Additional complexity arises when measures of each mixture component significantly deviate from the normal distribution, manifesting characteristics such as multimodality, asymmetry, and heavy-tailed behavior, simultaneously. This paper introduces a flexible model tailored for censored data to address these intricacies, leveraging the finite mixture of skew-t distributions. An Expectation Conditional Maximization Either (ECME) algorithm, is developed to efficiently derive parameter estimates by iteratively maximizing the observed data log-likelihood function. The algorithm has closed-form expressions at the E-step that rely on formulas for the mean and variance of truncated skew-t distributions. Moreover, a method based on general information principles is presented for approximating the asymptotic covariance matrix of the estimators. Results obtained from the analysis of both simulated and real datasets demonstrate the proposed method’s effectiveness.
有限混合物模型已被广泛用于异质群体数据的建模和分析。在实际应用中,由于实验设备的限制,这些类型的数据往往面临检测上限和/或下限的问题。当每个混合物成分的测量值明显偏离正态分布,同时表现出多模态、不对称和重尾行为等特征时,就会产生额外的复杂性。本文利用倾斜-t 分布的有限混合物,介绍了一种为删减数据定制的灵活模型,以解决这些错综复杂的问题。本文开发了一种期望条件最大化算法(ECME),通过迭代最大化观测数据的对数似然函数,有效地得出参数估计。该算法在 E 步有闭式表达式,依赖于截断偏斜-t 分布的均值和方差公式。此外,还提出了一种基于一般信息原理的方法,用于逼近估计值的渐近协方差矩阵。对模拟数据集和真实数据集的分析结果证明了所提方法的有效性。
期刊介绍:
Computational Statistics (CompStat) is an international journal which promotes the publication of applications and methodological research in the field of Computational Statistics. The focus of papers in CompStat is on the contribution to and influence of computing on statistics and vice versa. The journal provides a forum for computer scientists, mathematicians, and statisticians in a variety of fields of statistics such as biometrics, econometrics, data analysis, graphics, simulation, algorithms, knowledge based systems, and Bayesian computing. CompStat publishes hardware, software plus package reports.