{"title":"融合局部密度和近似距离的非参数离群点检测","authors":"Zhiyu Chen , Can Gao , Jie Zhou , Ying Yu","doi":"10.1016/j.asoc.2025.113898","DOIUrl":null,"url":null,"abstract":"<div><div>Outlier detection is an essential yet challenging task in intelligent data analysis, and some density-based unsupervised methods have been introduced to identify outliers in low-density regions. However, these methods still suffer from inaccurate density estimation and limited capability in detecting diverse types of outliers. In this study, we propose a nonparametric outlier detection method with the fusion of density and distance (POD-FDD). The proposed method employs adaptive kernel density estimation based on natural neighborhoods, which reduces the sensitivity to parameters in density estimation. Moreover, the optimistic and pessimistic densities are introduced to enhance the reliability of density estimation in the local neighborhood. In addition, approximate reachability distance information is integrated to improve the capability of identifying cluster outliers. Ultimately, a robust parametric-free outlier detection method is developed to detect different types of outliers. Extensive comparative experiments and statistical significance analysis on synthetic and public datasets demonstrate its superior performance, achieving an average improvement of 1.97 % in the AUC metric.</div></div>","PeriodicalId":50737,"journal":{"name":"Applied Soft Computing","volume":"185 ","pages":"Article 113898"},"PeriodicalIF":6.6000,"publicationDate":"2025-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Fusing local density and approximate distance for nonparametric outlier detection\",\"authors\":\"Zhiyu Chen , Can Gao , Jie Zhou , Ying Yu\",\"doi\":\"10.1016/j.asoc.2025.113898\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Outlier detection is an essential yet challenging task in intelligent data analysis, and some density-based unsupervised methods have been introduced to identify outliers in low-density regions. However, these methods still suffer from inaccurate density estimation and limited capability in detecting diverse types of outliers. In this study, we propose a nonparametric outlier detection method with the fusion of density and distance (POD-FDD). The proposed method employs adaptive kernel density estimation based on natural neighborhoods, which reduces the sensitivity to parameters in density estimation. Moreover, the optimistic and pessimistic densities are introduced to enhance the reliability of density estimation in the local neighborhood. In addition, approximate reachability distance information is integrated to improve the capability of identifying cluster outliers. Ultimately, a robust parametric-free outlier detection method is developed to detect different types of outliers. Extensive comparative experiments and statistical significance analysis on synthetic and public datasets demonstrate its superior performance, achieving an average improvement of 1.97 % in the AUC metric.</div></div>\",\"PeriodicalId\":50737,\"journal\":{\"name\":\"Applied Soft Computing\",\"volume\":\"185 \",\"pages\":\"Article 113898\"},\"PeriodicalIF\":6.6000,\"publicationDate\":\"2025-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Applied Soft Computing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1568494625012116\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Soft Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1568494625012116","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Fusing local density and approximate distance for nonparametric outlier detection
Outlier detection is an essential yet challenging task in intelligent data analysis, and some density-based unsupervised methods have been introduced to identify outliers in low-density regions. However, these methods still suffer from inaccurate density estimation and limited capability in detecting diverse types of outliers. In this study, we propose a nonparametric outlier detection method with the fusion of density and distance (POD-FDD). The proposed method employs adaptive kernel density estimation based on natural neighborhoods, which reduces the sensitivity to parameters in density estimation. Moreover, the optimistic and pessimistic densities are introduced to enhance the reliability of density estimation in the local neighborhood. In addition, approximate reachability distance information is integrated to improve the capability of identifying cluster outliers. Ultimately, a robust parametric-free outlier detection method is developed to detect different types of outliers. Extensive comparative experiments and statistical significance analysis on synthetic and public datasets demonstrate its superior performance, achieving an average improvement of 1.97 % in the AUC metric.
期刊介绍:
Applied Soft Computing is an international journal promoting an integrated view of soft computing to solve real life problems.The focus is to publish the highest quality research in application and convergence of the areas of Fuzzy Logic, Neural Networks, Evolutionary Computing, Rough Sets and other similar techniques to address real world complexities.
Applied Soft Computing is a rolling publication: articles are published as soon as the editor-in-chief has accepted them. Therefore, the web site will continuously be updated with new articles and the publication time will be short.