Handling skewness and directional tails in model-based clustering.

IF 1.2 3区 数学 Q2 STATISTICS & PROBABILITY
Statistical Papers Pub Date : 2025-01-01 Epub Date: 2025-07-04 DOI:10.1007/s00362-025-01723-9
Cristina Tortora, Antonio Punzo, Brian C Franczak
{"title":"Handling skewness and directional tails in model-based clustering.","authors":"Cristina Tortora, Antonio Punzo, Brian C Franczak","doi":"10.1007/s00362-025-01723-9","DOIUrl":null,"url":null,"abstract":"<p><p>Model-based clustering is a powerful approach used in data analysis to unveil underlying patterns or groups within a data set. However, when applied to clusters that exhibit skewness, heavy tails, or both, the classification of data points becomes more challenging. In this study, we introduce two models considering two component-wise transformations of the observed data within a mixture of multiple scaled contaminated normal (MSCN) distributions. MSCN distributions are designed to enable a different tail behavior in each dimension and directional outlier detection in the direction of the principal components. Using the transformed MSCN distributions as components of a mixture, we obtain model-based clustering techniques that allow for 1) flexible cluster shapes in terms of skewness and kurtosis and 2) component-wise and directional outlier detection. We assess the efficacy of the proposed techniques by comparing them with model-based clustering methods that perform global or component-wise outlier detection using simulated and real data sets. This comparative analysis aims to demonstrate which practical clustering scenarios using the proposed MSCN-based approaches are advantageous.</p>","PeriodicalId":51166,"journal":{"name":"Statistical Papers","volume":"66 5","pages":"114"},"PeriodicalIF":1.2000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12226708/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Statistical Papers","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1007/s00362-025-01723-9","RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/7/4 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"STATISTICS & PROBABILITY","Score":null,"Total":0}
引用次数: 0

Abstract

Model-based clustering is a powerful approach used in data analysis to unveil underlying patterns or groups within a data set. However, when applied to clusters that exhibit skewness, heavy tails, or both, the classification of data points becomes more challenging. In this study, we introduce two models considering two component-wise transformations of the observed data within a mixture of multiple scaled contaminated normal (MSCN) distributions. MSCN distributions are designed to enable a different tail behavior in each dimension and directional outlier detection in the direction of the principal components. Using the transformed MSCN distributions as components of a mixture, we obtain model-based clustering techniques that allow for 1) flexible cluster shapes in terms of skewness and kurtosis and 2) component-wise and directional outlier detection. We assess the efficacy of the proposed techniques by comparing them with model-based clustering methods that perform global or component-wise outlier detection using simulated and real data sets. This comparative analysis aims to demonstrate which practical clustering scenarios using the proposed MSCN-based approaches are advantageous.

在基于模型的聚类中处理偏度和方向尾。
基于模型的聚类是一种在数据分析中用于揭示数据集中的底层模式或组的强大方法。然而,当应用于表现出偏态、重尾或两者兼而有之的聚类时,数据点的分类变得更具挑战性。在本研究中,我们引入了两个模型,考虑了在多尺度污染正态分布(MSCN)混合分布中观测数据的两个分量转换。MSCN分布的设计是为了在每个维度上实现不同的尾部行为,并在主成分的方向上进行定向离群检测。使用转换后的MSCN分布作为混合物的组成部分,我们获得了基于模型的聚类技术,该技术允许1)在偏度和峰度方面具有灵活的聚类形状,以及2)组件明智和定向异常值检测。我们通过将所提出的技术与基于模型的聚类方法进行比较来评估它们的有效性,这些方法使用模拟和真实数据集执行全局或组件异常值检测。这个比较分析的目的是证明使用基于mscn的方法的实际聚类场景是有利的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Statistical Papers
Statistical Papers 数学-统计学与概率论
CiteScore
2.80
自引率
7.70%
发文量
95
审稿时长
6-12 weeks
期刊介绍: The journal Statistical Papers addresses itself to all persons and organizations that have to deal with statistical methods in their own field of work. It attempts to provide a forum for the presentation and critical assessment of statistical methods, in particular for the discussion of their methodological foundations as well as their potential applications. Methods that have broad applications will be preferred. However, special attention is given to those statistical methods which are relevant to the economic and social sciences. In addition to original research papers, readers will find survey articles, short notes, reports on statistical software, problem section, and book reviews.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信